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ABSTR ACT - ^ 

A computer-assisted instruction (CAI) project focused 
primarily on curriculum development in three technical areas: 
science, mathematics, and communication skills. The project also 
sought 1) to develop specific course material and methods of 
presentation; 2) to provide explanations of various techniques and 
strategies for dealing with course development, with emphasis on the 
education of vocational education teachers; 3) to Evaluate and 
articulate the combination of CAI with othef educational strategies, 
and 4) by means of careful experimentation, to determine optimum | 
formats for vocational -technical material taught with computer 
assistance. The four-year project used first an IBM 1410 computer and 
then an. IBM 1500; programs were in the COURSEWRITER language. In this 
report the curriculum ina^erlal in mathematics^ spelling^ engineering 
science, testing, and occupational guidance are presented in some 
detail, along with the systems programs for display and coding, 
research studies into educational stratv^gies and equipment 
evaluation, and the flowcharts developed by the project. The 
dissemination activities of thfe project are summarized. (JY) 
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Focus of Projec^ 

The computer-assisted -ins tpucti on project focused primarily on curriculum 
development in three, technical areas: science, mathematics, and cominunl cation 
skills. Course development was deemed to be such a crucial area of investi- 
gation because the capabilities of computer-^assi s.ted instruction have fre- 
quently beeTi limited simply because of the lack of available "software." The 
project sought to. develop specific course material and methods of .presentation 
as well as providing explanations of various techniques and strategies for 
dealing with course development. y - 

There was an emphasis on the education of vocational education teachers. 
The project sought to explore the promising stre^Qf^ rapid pre- 

paration of vocational -technical teachers. Venn points to the cruciallty of 
university leadership in this task-: 




. . .the expdnsion^and Improvement of vocational and 
technical education are heavily dependent on some resolu- 
tion of the teacher-training question. . This cannot and 
will not happen through the efforts of people already In 
the field; higher education In particular must assume 
leadership in the preparation of vocational and. technical 
* teachers. .(Venn, 1964, p. 36.) ‘ 

Secondly, the project attempted the evaluation and articulation of com 



putei^'-assl sted instruction with other educational strategies, and, by means of 
carefs]^ experimentation, determined optimum formats for vocationaV-technical 
material taugjjt with computer /assistance. This ■ application on an interdisci- . 
pi Inary basis is advocated by Brandon and Evans: 



Briefly, the broad nature of research results and 
research techniques at the oresent time in the various 
disciplines and fields of applj cation show interesting 
and profitable avenues for bur exploration and study: 

1. New methods of teaching and Teaming through 
many new media, numerous 'synthetics,' programed learning, 
computer-based Instruction, etc. Many aspects of so-called 
'related Instruction' in vocational education are uniquely 
/ adaptable to these media; (Brandon and Evans, 1965.) 
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The President’s Panel on Vocational Education (1962) advocated that eight 
out of ten of the twenty-six million young people who started, or who will 
start, work during the past decade (1966-197d) would have gained occupational 
competence through vocational -technical education. To this massive challenge, 
must be added the extensive retraining needs of hundreds of thousands of adult 
workers who are; presently underemployed or who have been automated or mecha- 
nized out of productive “employment. , 

Third, the curriculum development effort was accompanied by coordinated 
research and evaluation. Careful experimentation with CAI materials In natu- 
ralistic settings were required In order that the worth of the Innovations 
represented by the new approach to vqcatlonal education might be ascertained 
prior to widespread Investment 'In equipment and curriculum change. For this 
reason, a closely articulated gpearch effort was designed and Included In 
the overall research program plan for the Computer Assisted Instruction Labora- 
tory. ' ' ‘ ^ - ^ 

Fourth, the training and' dissemination programs within the Lab’s activ- 
ities were designed to supplement and balance the research, and development 
activities. The severe national shortage of curriculum and research special- 
ists In vocational -technical education has been traditional ; It -Is now crit-. 
leal . The fellowships, graduate assistantships and summer workshops Included 
In the Laboratory’s program were designed to help alleviate this shortage. 

With pespeetto dissemination; It Is clear that Innovations In education do 
no V Just happen. New inothodol ogles, new curricula, and new educational strate- 
gies must be Invented and communicated through as many avenues as possible In 
order to overcome the great Inertia 1 ti educational processes. Thus, the CAI 
Lab’s staff believed It as Important to disseminate cogent Information con- 
cerning Its activities and progress as It was toyerform continuing research 

and development. 

The research and development program was planned as a four-year effort 
with a careful build-up of equipment and personnel during the inltlafyear of 
.operation. The work of the project was carried on by an organization of two 
professional teams, one focused on the preparation of teaching materials In 
vocational -technical .subjects, and a second seeking answers to questions about 
computer-assisted Instruction by means of basic and applied research. About 
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twenty computer-presented Instructional units were prepared and tested by the. 



staff. These materials could be Integrated Into prototypes of vocational- 
technical education programs. In addition, the Lab caroled on a variety of 
training and dissemination activities designed to communicate the Innovation 
of computer-assisted Instruction to the public and the professions. 

V , . 

Funding of the Project , ; 

The project was conducted at Penn State University between July 1, 1965 
and December 31 , 1969. Funds were provided by the United States Office of Educa- 
tion on the following schedule: 



Instructional process may be thought of as being related to teaching machine 
technology, but CAI, because of its flexibility, decision logic characteris- 
tics, and sophistication o? Input-output mode, must be considered as a quantum 
advance over traditional programed Instruction. Projects using a computer fbr 
Instruction are similar to eadh^ other, but differ In their emphasis. The 
flexibility of the digital computer allows for a variety of themes different 
fr^m and richer than the themes of . programed Instruction as represented In the 
programed text or simple teaching machine. One. such ..theme thjB , extent to 

which Input and output displa ys facilitate coiimiunl cation beb|»ee^ 
and the computer, e.g., cathode ray tube display, varlouvlarge capacity 
random access visual and audio devices, special resporfse keyboards, light pens,- 
etc. Multi -media Interfaces between learner and ^computer seem' to, be necessary 
with reliktant learners and the handicapped^ th^^ be required for 

teaching complex material such as the teacjjfng of reading Good display and 




1964- 65 (1 mo. only) - $ 7,236 

1965- 66 162,521 . 



1966-67 
' 1967-68 ^ 

1968-69 ^ 



310,Bo1 

' ^ ' 

206,000 . 



Total 



- 273,130 

-.$95^,888 * 



Themes In Computer Assisted Instruction 

* Research and development Involving the use of a computer to assist In the 



response cibvlces are particularly attractive to the researcher concerned with 




Instruction, but at the same time handmade Interface equipment does not 
stimulate research In other laboratories because the special equipment Is 
generally of experimental of prototype construction arid extremely expensive. 

Two efforts that emphasize this theme In computer aided Instruction are those 
of Bitzer and Easley (1964)-, and Suppes and Ginsberg (1962). 

A second theme 1 s to adapt course organization to Individual student ' s 
needs ; here the concept Is to monitor, and analyze student performance, and, on 
. the basis of this performance plus othejj* historical Information about the 
Individual student, continually adjust .the course organization to optimize It 
for every particular student's progress. Such tailoring of materials to an Indl 
vidual student Is highly desirable, but In the occupational area adequate 
tailoring to the student his/tory Is difficult. Tailoring to long-term per- 
formance of a sjtudent Is. possible, but of relative high cost because. consid- 
erable -computer cupfblllty would be needed for each student. To some extent, 
this Is the approach of Stolurow and David (1963), and Smallwood (1962). 

A third theme Is that of tutorial Iriteractlo^ ; the concept Is that the 
high speed logic of the computing machine reacts to the detailed features of 
student performance on specific tasks, 'observes the efforts qf the student In 
dealing with these tasks, and presents appropriate remedial or accelerated 
action where the student Is not succeeding of Is Insufficiently challenged. 

The tutorial Interactlori Is supplementary to the strategic job of adjustirig 
the arrangement and d1 f f 1 cul ty* of the tasks and their manner of presentatl on 
to the Individual student. This approach Is exemplified by the effort at 
IBM's T. J. Watson Research Center by.UtalT (1961). 

“ A fourth theme Is process of simulation ^ garni ng between ^ Ar- 
dent and the machine ; here the role of the machine Is that of simulator of a 
' process or as an opponent with which the student Interacts, just as he Inter-^ 
acts 1^1 th process or persons In laboratories or real situations. This theme 
Is prominent In the work of Feuerzeig (196<*', at Bolt, Beranek; and Newman, 
Inc., and Wing (1966), at the Board of Cooperative Educational Services, 
Westchester County, N. Y. Public Schools (Swets, 1962). 

JThe present project In computer-assisted Instruction emphasized tutorial 
1 nteract 1 on, and made limited use -of the other themes described. We believe 
that e^ch of the emphases described above represents a valid conception of an 
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approach to the use of computers as educational aids, but -that the approach we 
have selected Is an appropriate one for education, to the extent that thO 
research and development coimltment Is pointed toward partial sMutlons of Im- 
mediate problems as well, as to those of a long-teim nature. Curcent and |)ro- 
jeeted needs force administrators to consider Instructional cost,lboth for the 
development of courses, and the administration of these courses by the computer 
In "production" teaching. This research established a flexible Interface 
between, the learner and the computer, but at the same time It utilized a system 
that Is justifiably economical In the 14ng run to allow for wide-scale adapta- 
tion to a variety of educational operations. ' ■ 

He prepared the Instructional materials In the present project In the same 
manner that we used for developing four college courses upder a previous con- 
tract With the U. S. Office of Education. Unlike most developmental projects 
In CH, we. have not devoted resources to the Invention of terminal hardware 
or to the writing of computer programs In machine language.. We avoided these 
tasks by using a conmierclally available typewriter terminal as the Interface 
between the computer and the student, and using the Coursewriter program devel- 
oped at the IBMT. J. Watson Research Center for controlling this Interchange. 
Virtually all of Our resources were devoted to the preparation of the educa- 
tional materials presented by the tauter since It appears that a major 
limiting factor In th^ltlroate wl.de-scale use of computers as an educational 
aid will be the tlme^n^ssary to prepare the educational materials. 

The courie development under this contract was an eclectic one In which 
current theory, practice of teaching, and programed Instruction were adapted 
and assimilated to the preparation of these courses rather than trying to pre- 
pare materials based more directly on current learning theory developed In the 
learning laboratory. This approach appears to have resulted In efficient pre- 
paration of'materials that teach well, and materials suitable for theoretical 

learning studies. This eclectic approach, coupled with a concentration of 

resources In course development, made It possible to prepare an extensive set 
of post-secondary course materials designed specifically for computer presents. 
jrton. However, we must admit that Improved hardware has made a good portion 

of our course materials obsolete. 
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Objectives of the Project 

The Computer Assisted Instruction Lab at Penn State sought to achieve a 
wide varlety^of curriculum development, research, training, and dissemination 
objectives. Accordingly, the specific objectives were organized under the four 

headings. ' : 

Curriculum Development O bjective . The curricul urn development objective 

was^ to prepare curriculum matinlal for computer presentation of selected tech- 
nical-vocational subjects suitable for youth and adults In the first two years 
of post-high school education. 

* Research Objecti ves . The research ’objectives were 1) to evaluate the 
resalts achieved l(n student programs employing CAI and the articulation of CAI 
with other components of Instructional systems; 2) to evaluate by means of 
experimentation lb fundamental research questions within CAI, topics .dealing with 
the effectiveness of different forms of knowledge of results— for example, 
optimal post-feedback Intervals, social and motivational components In know- 
ledge of results, and relationship of typing skill to learning and retention; 
and 3) to study the feasibility of adapting a wide vaHety of vocational educa- 
tion teaching material to CAI modes of presentatl^ and to make recommendations 
to appropriate federal and state educational agei^c^for future feasibility, • 
field testing, demonstration, and pilot ewperlmentatflmr-^^^ 

Training Objectives . The training objectives were 1) tb train an Inter- 
disciplinary group of research fellows as vocational educational curriculum* 

, research specialists to the level of the doctoral degree; and 2) to. train » 
through summer workshops a group of vocational educational educational subject 
matter specialists In course writing for computer-assisted Instruction. 

Dissemination Objectives .' The dissemination objectives were to dissemi- 
nate the results of CAI research development to school systems, colleges, and 
governmental agencies, making available CAI’ materials and know-how In ^^e form 
of reports, journal articles, "hands-on" demonstrations, conferences, talks, 
computer programs, video tapes, films, and television programs. 

It was possible for the Investigators ,t6 achieve a coordinated and Inte- 
grated approach to the wide variety of activities and study that needed to be 
pursued as shown In the objectives above. 
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CHAPTER* II 
CAI AT PENN STATE 



What Is CAI ^ 

Throu-gh the use of a computer 1h which a course Is programed and stored, 
the student can receive Instruction which Is Individually paced and presented. ^ 
This Instruction may be tutorfal In nature., be a problem simulation, consist 
of drIlVand practice, present Infonnatlon, or be a combination of all four 
types. The course materials for tutorial computer-assisted Instruction are 
store.d in the computer, and the 1nfon«t1dn Is presented to students at special 

computer connected Instruction stations. 

Two computer sys4ms wire used duHng the project. An IBH 1410 system 

was used from 1965-19W and the IBlH 1500 system was used from 1967-1969. For 
a period of several months, there was an overlap of the systems. For a more 

complete description, iee Chapter III. 

An important aspect of computer-assisted Instruction Is the spged at which 

the computer presents Information to tt^^e students taking the course. ly 
time-sharing situation, the 1nd1v1di,a1 Udent feels that the computer Is pre- 
senting only his lesson even though other students are taking the same course 
or other, courses at the same time. This time-sharing Is possible because the 
computer reacts In. microseconds while a student reacts In terms of secon s or 

even minutes. k® 

In using thevcomputer for Instruction purposes, questions can be pre- 
sented by. the computer; the student can respond by using the typewriter key- 
board attached to a cathode-ray tube (CRT). In addition, on Instructional 
stations which incorporate a CRT. It Is possible to have the student use a . 
light pen to respond to questions. The student presses the light pen aga nst 
his answer choice; the light sensitive pen receives the light and the position 
of his choice Is recorded. Responses from the keyboard or light pen can then, 
be analyzed by the computer, and the student, may be given feedback corresponding 
to the response made. An audio unit allows the student to record responses 
which may be analyzed by the Instructor after the student has signed off t e 

course. • 
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since the computer has the capability to. record and recall student . 
responses, the number of correct ansvfers; the number of wrong answers, etc., 
the sequence of Instruction for a particular student can be altered on the 
basis of his response history. More challenging material or remedial Instruc- 
tion can be presented on the basis of past performance, or sections of the 
course may be Skipped If the student's performance Is at a specific level of 
proficiency. And If the student stops Interacting with the computer for a 
period of time while taking a course, when he signs on again. Instruction will 
resume where he stopped previously. 

The computer can be used to record a variety of types of Information for 
all students, e.g., the exact contents of his response, the number of seconds 
"he takes to respond, and his exact position in a course. Summary Information 
such as number of correct responses to a question, total number of response 
attempts, etc., may be produced for analysis by the Instructor thereby reducing 
the teacher's clerical duties, and freeing him to give Individual Instruction. 

The nature of the computer Input Is such that -It will accept course con- 
tent In two ways: 1) course statements may be punched on cards, or. 2) course 

material may be Input directly Into the computer from the Instructional station 
keyboard. Using the second method, the contents of a course can be replaced, 
corrected, or deleted easily and quickly by special ^author commands. 

Coursewriter I_ and II 

At the beginning of the project, the developed courses were written In 
the CAI author language known as Coursewriter I for use with the IBM 1410 com- 
puter system.^ A comple.te description of Coursewriter I Is beyond the scope of 
this report; however, because It Is standard IBM language. It Is readily avail- 
able. . ^ ’ 

The period be^we^ January 1, 1968 and Jj/ne 30, 1968 was- a time of transi- 
tion Iri hardware In the CAI Lab. A change was made from the IBM 1410 to the 
IBM 1500, and In author language from Coursewriter I (Yorktown Heights version) 
to Coursewriter II. Staff efforts during that period went Into the completion 

• . . » I 

of experimental studies begun on the typewriter terminal-, the translation of 
carefully selected course material from the, old author language 1ni» a new, 
considerably more flexible language, and the development on the part of the staff 
of nw skills and new teaching strategies for the richer learning environment 
provided by the 1500 system (IBM Corporation, 1968) . 



Programing Language 



• To assist In provldlnjg an answer to the question as to how Instruction 

. ' * V > 

strategies are prepared for the computer, the following excerpt from the IBM 
1500 Coursewriter II. Author's Guide , Part U Course Planning Is Incl uded here. 

The Coursewriter language Is composed, of Individual Instructions 
that can be logtcally separated Into five major groups. 

Problem presentation 

Presentation sequence control 

Response r^uests 

Response analysis 

Scorekeeping 

The problem presentation Instructions are used to mark the 
beginning of a problem, to type and display Instructional material, 
to play audio messages, and to project Images from film reels. 

The response request Instructions enter and process student 
responses from the light pen and ’from the typewriter and Instruc- 
tional display keyboards. They also^ record audio messages, con- 
trol the time allowed for responses’* aTid cause perf^ance records 
to be written automatically (If the author has specified them). 

The response analysis Instructions determine whether a 
response I5 correct. Incorrect, or unrecognizable. Special program- 
ming Is built Into the system to handle matching bf responses 
automatically. . , 

The scorekeeping Instructions permit the author to channel Into 
perfonnance records the counts of a student's correct answei^, wrong 
answers, time-outs, etc., and to post other special Indicative 
Infonnat Ion. They also permit the authdr to "capture actual 
responses and work with them by executing special routines during 
answer processing. 

The presentation sequence control Instruction^ allbw the author 
' to provide several paths of Instruction based on conditions that 
arise while students are actually taking the course.' They also allow 
« the author to link course segments as needed tp complete course flow 
through an Instructional session. (IBM Corporation, 1967, p. co,) 

Course programing languages other than Coursewriter provide instruc- 
tions to carry out similar action. With systems dedicaVe^to computer assisted 
Instruction, changes and additions can be made In the pif|ogram1ng language. 
Functions can be written to provide special processing hot Included « part of 
the' programing language, and these functions can be accessed within tne course. 
Thus; a great deal of flexibility Is provided. 



Flowcharting 

Flowcharting Is a means of presenting a course description so that It Is 
easy to visualize and follow. Simple geometric figures are used, to show the 
flow pf the, course through which a student may pass. A flowchart may be used 
while a course Is being developed tp experiment with the sequence of presenta- 
tion or may te used as a means of communication between the curriculum special- 
ist or course author and a programer. Flowcharts. can depict major logical 
steps or any degree of detail desired and are commonly used as a means -of 
documenting a program. An overran course flowhcart would Indicate general ^ 
steps without much detail; whereas a detailed program flowchart Is a map of 
the program. A program flowchart should be labeled so that the associated 
instructions from the programing- ^language are referenced; thus, un'derstandings 
and modifications of the course are both facilitated. 

Flowcharting symbols used In this project were generally consistent with 
IBM flowcharting symbols. Since programing for computer-assisted Instruction 
Is different from -programing for other purposes, the .meanings of some symbols 
were altered to fit our particular situations. For example. In flowcharting 
CAI programs, a few symbols were adapted from those usually used only for flow- 
charting symbols. The symbols used for flowcharting In this project all appear 
on the Standard Register Business Forms flowchart template. 

Figure 1 , page 11 : Is an example of a flowchart of the type used In the ' 
project. This Is such a critical area In programing that the strategies devel 
oped w111.be briefly described.^ Briefly,' It Is the computer operation, pro- 
gramed by the course author. Which moves the student to remedial or advanced 
work. It allows the author, via the computer, to fit the course to the student 
* In the diagram shown 1h Figure 1 , the student may choose three routes. He may 
elect to take a quiz, receive feedback on the. adequacy of his knowledge, and 
then move tovthe beginning or end of the course. He can also receive Instruc- 
* tion, move^ a review, and then take the quiz. H1s third choice would be to 
go directly to the review, then to the quiz. Instruction, or to another review. 

■ Additional flowcharts for specific Instructional strategies can be found 
on page 107 of this report. 
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Fig. 1. Example of a flowchart of the type used In the CAI project. 
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CHAPTER -III. 

^ THE DEVELOPMENT of' HARDWARE AND FACILITIES 

Physical Facilities . 

To Initiate the vocational -technical CAl project, a large room, 45 feet 
by 45 feet, was remodeled and the space was dies Igned to accommodate approxi- 
mately ten professional staff members, eight graduate assistants, five CAI 
tefchniclans, and four student terminals, each with audio-visual components and 
a printing desk calculator. ^ From Its own resources, the University made avail- 
able new .office furniture and equipment and^nstalled air conditioning and 
electrical controls In the space occupied (by '^the heat-generating terminals. : 

Equipment Evaluation 

' In July, 1965, two student termlnal^ln the CAI Lab were connected by 
means of dedicated long distance telephone 'lines to^the IBM 7010-1448 computer 
configuration at the T. J. Watson Research Center, IBM Corporation, Yorktown 
. Heights, New York. The Lab was under contract for this service until June 30, 

1966. The '^servl ce Included not only,»64 hours of terminal time weekly, but 

‘ compiled course listings and. summarl 2 ed student records taken from log magnetic 

tapes.; ‘ ^ 

Delivery of four new IBM 1050 communications terminals with Improved 

audio-visual components, expected In October, 1966, was delayed.. Installation 
0 of this' equipment, replacing the two ‘"bench-built" uni ts , occurred In January, 

1967. Orders were placed for the a<id1tl6nal, four terminals to be .Installed In 

Williamsport and In Altoona by July, 1967. 

.By June, 1966, the project was almost completely moved Into Its new 
remodeled quarters. The hew facility was extremely .weTV sijited to the needs'- 
of the project and staff. Four new student terminals were Installed In four 
separate sound-proofed and air-conditioned rooms. The Laboratory office 
.space completely accommodated the staff of the project. 

By July, 1966, conversion to Penn State's own 1410 computer system had 
been completed', and CAI courses prepared to date operated successfully on this 
system. The new system controlled four"’ student terminals In the Laboratory,- 
two additional' terminals located at the Williamsport Area Community College, 



and two terminals on Penn State's Commonwealth Campus in Altoona « The four 
student terminals In the field were installed and available for student Instruc- 
tion by mid-July, 1966. Students enrolled at these two schools were used for 
research and evaluation of th6 CAI courses In technical education during the 

. f 

summer,. 1966. The schematic In Figure 2 shows this geographic arrangement of 
equipment. 



STUDEm' TERMINALS 
WILLIAMSPORT AREA 
COMMUNITY COLLEGE, 

Williamsport, Pa. 




STUDENT TERMINALS 
C-A-UAB 



University Park, Pa 





COMPUTER 



COMPUTER CENTER 

University Park, Pa. 



^StUDENT TERMINALS 
ALTOONA CENTER 

Altodria,Pa. 



Fig. 2. Schematic showing geographic arrangement of CAI. stude»1t terminals, 
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The research and development progress 1n CAl completed up to December 31, 
1967, was accomplished on a hardware configuration organized around an IBM 1410 
computer as a central procejssor used In time-sharing mode and located In Penn 
State's Computation Center. Connected to the central processor by telephone 
lines, the CAI Lab maintained eight student stations consisting of IBM 1050 
typewriters, each augmented by a random access tape recorder and a random access 
slide projector. This modi fled business- application equipment provided service - 
as has been described for two and one-ha'lf^^years, but was replaced late In 
December, 1967 with an eight teriTilnal IBM 1500 Instructional system. The new 
system., designed for Instructional purposes , \offered numerous advantages over 
the former. Displays of materials are achleved^litost Instantaneously on the • 
CRT terminal Instead of the tedious, typewriter type-out. Student's answer 
processing was vastly Improved. Last, but not least, the cost per student 
terminal hour was about one-fourth of the former 1410/1050 system. i 

During the first half of 1968, the project staff was primarily ehQaged. 
the translation of experimental course materials from Coursev/rlter I,' the 
author language of the IBM 1410 system’, to Coursewriter II i the author lan- 
guage of the IBM 1500 system, in addition, the Lab learned the Intricacies of^ 
the new hardware/software configuration and developed new dictionaries and 
"macros." Studies were Initiated during period which built upon what-^they ^ 
' already learned about response modes, sequencing, and student attitudes; 

Due to bujlget cuts for the 1968-69 fiscal year, the Lab reluctantly had 
to withdraw the teVm;lnals from Williamsport and Altoo.na. Both Institutions 
had „prov1ded us with unstinting cooperation In the selection of technical 
education students who served as subjects, the faculties of both .schools had ^ 
provided many hours of valuable consul tatloh on curriculum- and display 
problems. 
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CHAPTER IV 




CURRICULUM MATERIALS 


■;v. 


> 




Mathematics 


Technical Mathematics - 




(IBM 1411^ Computer System) 





The technical mathematics curriculculum (Ritchey, 1965) embodied In this 
CAl course Includes the following topics: graphing, exponents, roots, trigo- 

nometry, simultaneous quadratic equations ,_ calculus, logarithms, vector analy- 

sis, algebra, ratio, and proportion. ' 

By design the fj^^s^egments programed are common to both physics and 

mathematics 1nstruc|6on. The common segments Include the metric system, 
working with' units, 'and significant figures. A summary of the course segments 

and their content follows: . 

. . ,Bas1c Mathematics . A review of basic mathematics; course Is developed by 
presentation of square root, cube root, and estimating square root and cube 
root. Estimated time: hour. 

Slonlftcant Figures . Instruction In the accuracy of calculations used In 
scientific experimentation. The student is taught the reasons for limiting 
. the number ^f digits In the results of his calculations. This version teaches 
•the course by telling the student the reasons for using significant figures, 
but does not present rules for using significant figures. Estimated time: 90 
minutes. (Also programed are three additional experimental versions of signi- 

^ ficant figures.) 

Graphs . Definition of basic terms used In graphing; construction and 
Interpretatlbn of graphs with a physical rather than an algebraic slant. 
Estimated time: 11/2 hours. 

Logarithms . Program Instructs student In logarithms and the w of loga- 
rithms and the use of logarithm functions and working technical programs. 

Estimated time: ,11/2 hours. , 

Triaonometry. A study of the applications of the elementary functions of 
trigonometry. The student learns to use tables, to Inteirpolate, and to per- 
' form, mathematical operations with the trigonometric functions . Estimated 

time: 3 1/2 hours. ^ 
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♦ Victor Analysis . A segment that teaches factors and the law of cosines 
and sines. 

Simultaneous Equations . A segment on how to solve simultaneous linear 
equations by algebraic methods. The presentation of the material Is developed 
through substitutions "trial and error," and thence to algebraic subs tltutlpn^^ 
The final method presented Is algebraic solution us Ing^ltl plication and 
addition. E'StImated tfime: 1 hour. 

Algebra. The second part of basic mathematics, a continuation of remedial 

* * 

math. Content; algebra. Estimated time: 45 minutes. 

hatio Proportion . A continuation of basic mathematics. This segment 
develops ratio and proportion and Is the terminating sequential course for the 
basic mathematics sequence; Estimated time:* 1 hour. 

Test. on ra-. rb- . and re-math segments . Test on the material covered In 
ra-,. rb-, re math segments. Includes test on exponents, roots, algebraic 
expression, ratios and proportion. Test presented via 2 x 2-1nch slides and 
feedback given for each question. Estimated time: 45 minutes. 






Number Systems - 

(IBM 1410 Computer System) • . ^ • 

A program entitled Number Systems (Sands, 1966) was written for the pur- 
pose of Investigating techniques of developing computerized Instructional 
materials In the area of mathematics. The program -consists of approximately 
840 Coursewriter statements and takes an estimated 3 hours for a student to 
complete. 

The objectives of this program are as follows: 

Main Objecti ve ^ 

To have students acquire the ability to convert a number from 

one number system to another. For example: 231 (base five ® (base 

ten) 

Sub-ObJectI ves 

To recognize for any symbol In a number Its ^ulvel ant expres- 
sion containing a coefficient, base, and, exponent; an example of 
“ this would be to recognize 2(5^) as the equivalent of the 2 1n 
231 (base five). 
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To recpgnize the correct expanded form of any number; an 
example of this would be to recognize 4(9^) + 1(9®) as the equiva- 
lent of 41 (base nine). 

To recognize ^he correct numerical expression for a verbal ^ 
statement. An exWle of this would be to recognize ''20'' as 
equivalent to "two groups of the base in any number system. 

The programing strategy used Is a slight departure from most of the 
strategies used with Coursewriter. The major criteria for branching Is not the 
type of error response but In the amount of practice required to Achieve 
mastery within sections of the program. Also, an attempt has been made to 
keep error rate at a minimum. Students who do make errors are not required to 
type the correct answer, but are given an explanation of the correct solution 
and are automatically branched to the next Item. 

S1 1 de Rul e - 

(IBM 1500 Computer System) ^ 

This -Is. a course which provides Instruction on the use of a slide rule. 
The scales discussed are those used for: 1) multiplication (C, D, Cl); 

2) ' squaring and cubing numbers and teklng square and cube roots (A, B, k); 

3) finding logarithms (L) ; and 4) redding trigonometric functions (S andT). 



Soel 1 1 nq 

Two programs In spelling were developed In the CAI Laboratory. Both pro- 
grams were deslgned-for remedial Instruction for high school or post-high 
school students. The first program described was designed fdr use on the IBM 
1410 computer system. The second program Is built for the IBM 1500 computer 
system and Is available for use on the Lab’s present computer system. The task 
of building the second spelling program was facilitated by knowledge gained 
through the development and testing of the first program. 
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Communications ' Skills - Spelling - 
(IBM i4loToinpiiter Astern) 

The purpose of the CAI course In communications skills (Bjorkguist, 1965) 
was to develop and evaluate a cpmputer assisted program of instruction In 
remedial spelling for students preparing to be technicians. Jhe computer pro-^^ 
gram Was planned to diagnose the spelling errors made by Individual students 
and to branch students to remedial programs of Instruction appropriate for-the 
types of spelling errors made. It was anticipated that this course would be a 
prototype for the preparation of other communications materials. 

Students completed an orientation which Introduced them to the^selectrlc 
typewrilieri tape recorder^ and photographic 'Slide* outputs of the computer. It -vj 
also acquainted them with the typewriter they would use for responding and 
tried to Impress upon them the Importance of accurate spelling. Instruction 
In. Identifying word syllables and In listening. for correct pronunciation was 
Included. The orientation was followed by a diagnostic spelling test which 
Identified the types of spelling errors made by the Iv.dividual. Words In the 
diagnostic test are pronounced to the’ student via audio tape message, and he 
responds by typing the word on the computer typewriter keyboard. Based on an 
analysis of the responses made b^ the student, the computer branches those ^ 
students needing remedial work to one or more of nine remedial programs. 

The diagnostic test Is made up of words Involving nine types of spelling 
problems: plurals, homonyms, contractions and hyphenated words, words with 
1e and el combinations, double consonants, suffixes, e and y endings, words 
requiring visual discrimination, and "demon" words. A student who misspells a 
certain percentage of those words Involving one of the types of spelling errors 
Is branched to the remedial program of Instruction to correct that type of error. 

After completion of the remedial program, the student Is tested to deter- 
mine his degree of Improvement. Failure to show marked Improvement Ip cor- 
recting a type of spelling" error will repeat the remedial program for the stu- 

dent. V •< 

Words for the diagnostic and remedial programs are selected from graded 
spelling lists, themes written by students and from words used by technicians 
In their work. Emphasis Is placed on the Inclusion of those words which are . 
commonly used by technicians. 



Following completion of the orientation, diagnostic test, and remedial 
programs, the student completes a proofreading exercise. The purpose of this 
exercise Is to test the student's ability to recognize misspelled wrds In a 
printed page, to correct errors and to emphasize the Importance of^coofreadlng. 
The program In spelling concludes with a posttest’ composed of words rantjomly" 
taken from the same word list as the diagnostic test. , • 

Spelling - ^ 

(IBM 15od Computer System) 

This spelling course (Farr, Kelly, and Palmer,. 1969) consists of two tests 
and five Instructional segments. The pretest and posttest are parallel In 
format and In diagnostic structure, but the posttest had twice as many (100) as 
the pretest. In both of these multiple-choice tests, the student Is presented 
with one sentence at a time. Each sentence contains one blank space to be 
filled with the word appearing under the sentence. Three possible spellings 
for that word are* shown simultaneously with the sentence, and the student 
registers his choice of the correct spelling b^ touching the light pen to the 
spelling he Judges to be correct. The student's choice Is then evaluated as 
correct or Incorrect by a coijputer routine, and wrong choices are recorded In 
counters. Each student's cumulative totals of wrong responses Is available for 
each of the^flve error categories being tested. The student does not receive ; 
any evaluative feedback about his choices until he has compl eted, the test 
being taken. However, at the conclusion of both testi, he Is Informed of the 
number ,of errors that he made In each of the five categories. 

At the time this course was being developed, audio equipment for the 1500 
student stations was not available. And In view of the highly unreliable per- 
formance experienced Ip using tape-recorded spelling tests on the 1410 system,, 
as well as an Imnlnent termination date for the project, we decided to proceed 

without the use of audio equipment. 

Therefore, w(^ represente'd the possible pronunciations for the three 
spelling choices with a set of graphic symbols and manipulations. The symbols 
and manipulations used are modifications of a system for representing sounds 
which was devised by T. V. Barker of the Lehigh University Speech Department. 
The major advantage of Barker's system over other graphic systems. for 
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ropresGntIng sounds (o.go, tho Intornatlonal Phonatic Alphabat) >=is that all tha 
Barkar graphic symbols ara raadlly Idantif labia as 1 attars of tha English 
alphabat. Hanca« In spalling, tha graphic sound rapresantatlon of a Vord Is 
spall ad exactly like the standard alphabetical- representation of that word. 

When an alphabetic symbol has more than one possible sound (e.g., c^» 
vowels),! the position and/or form of the letter symbol Indicates the appro- 
priate sound for the word (I.e., spelling chplce) under consideration. For 
example. When £, £, and £ are voiceless, they are located one-half space above 
the home line of type; If they symbolize voiced sounds; they are located one- 
half .space below the home line of type, A vowel followed by a space Is always 
accorded ihe long vowel sound, and any> letter crossed by a slash ijiark Is a ) 

s11«nt letter. Outline and shaded letter symbols represent diphthongs and 
other special, sound combi patlons. Each student Is provided with a pronuncia- 
tion key (on paper) Illustrating each symbol as Its sound occurs In a common 

word, 1 ■ ' • / \ 

In the Instructions for the pretest and posttest, each studeht\ Is -Informed 



that he ca,L touclt his light pen to the word "help" (which appear^ In the s 
spot on the screen with each test question) If he wants to see hbw the choices 
are pv^noiinced. The program permtts hlih to return to the pronunciation (1,e, , 
"help") section as many times as he wants on each question. Counters are pro- 
gramed to! keep track of the number of times each student uses the help- 
section for each of the five different error categories being tested. 

Itenis covering the five error categories are presented In the same, order 
on the pretest and the posttest. Thus, the pretest contains a total of 5(1 
Items arranged In 10 groups of the following error categories: 'the doubling 
of finalj consonants, le.-^ words, the fonnatlon of plurals, words ending In 
silent e, and words ending In y^. The posttest contains a total of 100 Items 
arrange^ In' 20 groups of the same error categories, 

Betause the students for whom this course was planned are older adoles- 
cents, an attempt has been made to make the test sentences as 'unlike. the usual, 
unimaginative, monotonous spelling-test sentences as possible, while at the 
same time making them clear and not so Interesting as to be distracting. 
Depending on each student's performance on the pretest, he Is Judged 
either) to be In need of Instruction, In one or more of the five error categories 
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or not to be in need of such Instruction. If, on the pretest, a student makes ' 
no more than two errors In each category (1.e., If he misspells no more than 

» . f 

two out of ten words In a single category) he is judged to have .performed 
satisfactorily and ho does not receive instruction in that error category. 

Each category is judged separately, so a student could make as many as ten 
errors (i.e., two errors in each of the >1ve cateogries) and yet not be routed 
into instruction. The justification for tMs criterion level is that two 
errors out of ten possibilities represents an accuracy level of 80^. Since 
the expectation of perfect English spelling may be an unrealistic one for 
human beings, we settled on 80% accuracy as Indicative of knowledge and skill 
well beyond the level of chance, yet within the scope of attainment for students 
enrolled in post-high school study programs . V. 

When a student makes more than two errors In a category, he is auto- 
matically routed to the instructional sect1or\ dealing with the kind or kinds of 
errors that he made. After completing all instruction indicated as necessary 
(bn the basis of his pretest score), a student is expUciyy branched to the 
posttest, where the same criterion level holds. Hence > on the posttest, if a 
student spells 80% of the words in a category correctly, he is judged to have, 
achieved a satisfactory level of spelling performance (i.e.,. he makes ho more 
than four errors out of a possible twenty in each of the five cateogries). 

Only as a means of gathering information about the tests, we have, at 
this level of development, given the posttest to students who achieved our 
no-instruction criterion on the pretest. Ordinarily such students would be 

dismissed after taking the pretest. / 

Any student whose pretest score Indicates that he needs instruction ^Cne 
or more of the five error categories. Is systematically branched Into^nort, 
prologue segment called "Spelling Patterns." This segment has two^slc pgr- 
poses: 1) to alert the student to the presence and prevalence of^attems In 

English spelling; and 2) to present basic expository Inform^bn about vowels 
and consonants. The first of these purposes Is. essentially an attempt to draw 
upon a 1 Ingul Stic approach to the' study of spelling,^ contrast to the pro- 
bable, "There Is no rhyme nor reason to English selling" approach which most 
of our young adult students had previously encoghtered, The/second purpose 



was merely to ascertain that the students were knowledgeable about two funda- 
mental terms (consonants and vowels) which are used extensively In certain of 
the Instructional segments. . 

The CRT's potential for animated i>resentat Ion of material permits, the 
author to emphasize particular patterns and to build on those patterns In 
accord with; the concept(s) being dealt with at‘ the moment. This animation 
capacity of the CRT. has,’ as the> authors anticipated, proved to be one of Its 
most appreciated adyantages--espec1 ally when the subject matter Is approached 
rather reluctantly by students who have a general and prolonged history of 
failure in the subject. Both the content (I.e., the fact that there are pat- 
terns In Epgllsh spelling) and the graphic treatment of the content (I.e., 
meaningful arrangement and animation) tend to rfekindle hope In the students 
that this time Jth^ might really learn hqw to spell. The patterns prologue 
received favtf^ble comments— sometimes accompanied by pleasant surprise » 

The^oubllng Instructional segment 1^^ concerned with teaching; students 
how to detemlne whether or not the final consonant on a word^should be 
^^wbled when a ^fflx Is added to the word. To begin. with, the student Is 
asked to distinguish between vowels, and consonants. If he falls to do so 
satisfactorily, he Is given a brief review on consonants and vowels. The 
Instructional segment uses significant animation extensively. Illustrating 
doubled consonants, the settings In which they otfcur and do not occur, and 
the rule of the syllable number and accent, as well as the significant ^lement|^^ 
In the suffix to be added to the root word. After the instructional program 
has shown the separation of words Into their roots, suffixes, and doubled con- 
sonants (where necessary), the student 15 presented with a series of Internal 
quizzes In which he must deqlde whether to join the roots and suffixes' just as 
they appear on the screen, or whether or not to double the final consonant op 

the root word before adding the suffix. 

Hhen the sjtudent H«s passed this point, he Is presented with a sta^ept 
of the.rule and then Is quizzed on Its application. After each .iinlt of /. ; 

. Instruction, the student Is quizzed until his performance score reaches ;cr1v..-.' 
terlon; then he Is directed Into. a different and/or a more complex aspect' of ^ ^ 
the topic. The tdne of the evaluative'fiedback Is designed to be appropriate, ^ 
.for the student's performance: gentle and supportive at first,, more . ' 
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matter-of-fact as the number of trials to crlterlpn Increases. Drlll-and- 
practlce Is extensively Interspersed with Internal quizzes In all Instructional 
segments 

Spelp - 

(IBH 1500 Computer S.ys tern) ^ 

Spelp Is a computeir Instructlorial program for the understanding of prefixes 
and suffixes. The course contains a description of 1) the relationship among 
prefixes, suffixes, and root words*, 2) an exercise 4n typing the root when 
prefix a^sufflx are given, and 3) an extensive drill In choosing the correct 
word meamngs when the meaning of the prefix Is known. . 



y 

u 



Engineering Science 

Engineering Science - -‘J 
(IBM laioTomputer System) 

The planning of thIS/ course In engineering science (Gilman, 1965) Included 
comprehensive examination of the engineering technology and physics curricula 
of many vocational Institutions. Most of the available texts In tecjpfilcal 

physics. were reviewed. .f 

Because there Is a certain amount of subject matter common to physics and 
mathematics, these areas were programed' f1 rst. Topics In scientific notation, 
the metric system, working with units,, significant figures an<f kinematics were 
programed and tested by student subjects. Also, a chapter explaining the 
relationship between physics and engineering, was- programed and Is available. 
Short segments In magnetism and atomic energy were written and tested. 

The overall Instructional strategy for CAI Engineering Science and Tech- 
nical Mathematics begins with a common subject arid branches Into separate tech- 
nically oriented mathematics and physics courses. However, the separate courses 
are correlated, so that Instruction In physics topics are preceded by the pre- 
requisite. mathematics for that topic. 

The physics curriculum Includes beginning material of mechanics, heat, 
matter, electricity, magnetics, electronics, modern physics, light, and sound. 
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Technological adaptations of physics knowledge are stressed to a great 
degree. The structure of the science of physics. Is emphasized and provides a 
valid framework for learning fundamental concepts. A sumnary of the course 
segments In Engineering Science and their content are summarized below: 

'f Introduction to Physics . An Introduction to the science of physics. This 
segment describes the relationship of physics to engineering and chemistry, con- 
siders some elementary physics topics such <|S density, kinetic and potential 
energy, and the relationship between mass and energy. Estimated time: 1 hour. 

The Metric System of Measurement .* Teaphes “the student tp use the metric 
system of measurement and 'to make conversions from one system to another. The 
student learns to, make conversions through the proper multiplication and 
■division techniques required for unit conversion^ Estimated time: 1 hour. 

Working with Units . This short course presents a different treatment to 
the use of dimensional analysis (also known as factor labeling), In working 
physics problems. The student Is taught how to use the units given In a 
problem to find the units required In the problem's solutions A,i‘o, branching 
strategy Is determined by student's error rate. Estimated time-: 70 minutes. . 
(Also programed are four, experl mental versions of Working with l(n1ts.) 

.Significant Figures . Determination of final accuracy In scientific 
experiments through the use of. significant figures. Accuracy In measurement Is 
considered and rules are given for finding the correct accuracy In the, final • 

result. Estlmateid tlme^ 1 3/4 hours. , 

Use of Micrometer and Vernier Calipers . This segment teaches the use of 
the Vernier calipers and micrometer calipers as measuring Instruments. The 
student first receives Instruction on how to'manlpul^te the Instrument and to 
read the scales. He then makes measurements using' the Instruments. The stu- 
dent enters his readings at the terminal and they are compared with the measure- 
ments made by the course authors. 

Calculus and Kinematics . A discovery approach to the relationship of ‘ 
velocity and acceleration to differential calculus. The student develops the 
ability to associate the first and second derivatives of differential calculus 
with the graphical representations of velocity acceleration. Estimated 

time: 40 minutes. 
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> Heat Part I. An Introductory course on heat. The student. 1s Instructed 
in thermometry, kinetic energy of gases, and the expansion of solids, liquids, 
and gases. Estimated time: 2 hours. ' • 

Heat Part II. This Is another segment of the Introductory course In heat; 
In this segment the student Is Introduced to the concepts of specific heat, 

/ calorimetry, and the states of matter. Estimated time: .1 1/2 hours. 

Electrification . Includes theory pf electrostat^lcs^ Coulomb's Law and 
rela.t1onsh1p between forces and electrical charges. Estimated time: 11/2 

hours. 

Magnetism . A ve/y basic ^treatment of magnetism designed as Introductory . 
material to electromagnetic circuits and devices. Estimated time:** 75 minutes. 
“ Optics Part I. An Introductory course In optics. In this segment, the 

^ student Is presented Instruction In Illumination, reflection, and refraction. 

Estimated time: 2 hours. « 

Optics Part II . In this segment the student studies geometric optics as 
It applies to plane mirrors, curved mirrors, and lenses. Estimated time: 

2 hours. • 

Atomic Energy . Utilizes, the full facilities of compyter-assisted Instruc- 
tion to present an el^entary description of atomic energy. The student Is 
taught the relationship between atomic weight and the numbers of protons and 
neutrons In the atom. Estimated tlipe: 1 hour. 

Mechanics . Adjunct auto-1 nstructlonal program to provide supplementary 
Instruction during testing In the area of mechanics. Estimated time: 45 mln-i 

utes' to 2 hours. . ^ * 

Kinematics . Adjunct auto-lnstructlonal program to provide supplementary 
Instruction during testing In the area of kinematics. Estimated time: 45 

minutes to 2 hours. ' ' 

Meteorology . This metro segment* 1 ncl ydes the physical and meteorological 
aspects pf heat and scales commonly used on thermometers, and the common type 
of thermometers. 

Simulated Laboratory Physics Exerxise . SI physics Is a simulated labora- 
tory physics exerxise designed to provide the student with the concept of the^ 
variables Involved In a simple example of uniform, circular motion. The stu- 
dent Is 'Instructed to .Identify the variables in the situation, hypothesize 
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the relationships between the variables, request data, and evaluate his hypothe- 
ses. The student may request Information pertinent to the physical situation 
bn terms relating to the situation. 

■ Science , Getyyal , Content- of these two segments Is designed to update 
student's science knowledge and to provide student with more adequa-te science 
concepts.- Both segments automatically connect to ^fihyslcs, a macro program 
of pre-programed options which an author can use to specify strategies for any 

question frame. . ‘ 
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Measurement and Evaluation 

Several courses are available on the IBM 1410 computer In the measurement 
area. A brief description follows:' 

Student Opinion Survey . A CAI segment, administered on line. Is a meas- 
uring Instrument to evaluate the student's attitude toward computer-assisted 
Instruction. Twertty questions are presented via 2 x 2-1 nch slides; the system 
records the student's response and assigns a value of one through five to the. 
response depending upon where It lies on the continuum. System types out score, 
which may range from 1 to 100, and the accumulated response latency. Estimated 

time: 20 minutes. 

Computer Aptitude Test . Pretest for compat (computer -aptl tude test) . A • 
preliminary CAI ability measure designed for sequential presentation at the , 

student, termi nal . Estimated time: 30 minutes. 

Remote Associates Test . Computer administered Remote Associates Test of 
creativity. Thirty questions are presented via 2 x 2-1 nch slides. Those that 
are ^kipped are presented again and then a third time If, skipped the second 
time. Individual and total response latencies are pri nted out for each ques- 
tion as student proceeds, plus .the total score and the number of questions 
missed. Estimated time: 50 minutes. 



V 






37 



f 






f^'r- M. ny'-r--* <• . > 



r 



29 



:1J 

II 

•» 

u 

u 



'o’ 

ERIC 



» , 

Plan for the Development of A Pilot Computer-Assisted 
OccupatlonaT 15ul7ance Program 

The purpose of this section is fourfold: 1) to describe the initial • 
computer-assisted occupational guid^ce (CAOG) program developed in the Depart- 
ment of Vocational Education at P^n State; 2) to present the results of two 
field trials, In which the program was' utilized; 3) to describe the second 
generation version of the program developed In the CAI Laboratory;' and 4) to 
present a. planned third generation program and the rationale upon which It Is 
based ( Impel 1 1 tterl , Kostenbauder,' and Paolone, 1968). 

o • 

Description of Original 
Version oT ’cWG 

' C. 

The efforts devoted to the design and development of the Initial prototype 
of CAOG were a reaction to a growing concern. The objectives of the original 
project were, as stated in the Phase I report ( Impel 11 tterl , 1968): a) to 
develop a pilot occupational information retrieval and transmission system 
which would stimulate a selected segment of the ninth grade population to 
explore occupations on their own; b) to structure the occupational information 
transmission and the procedures by which the information Is retrieved In such 
a way as to -develop In the boys who are exposed to the system* the acquisition 
of strategies for career exploration; and c) to develop a vocational guidance 
support system focusing upon occupational Information which represents an 
Integral part of the total guidance services In a school* 

i The focus of the Initial program was^^on the storage and transmission of 
atlonal Information by way of a computer-based terminal .device as a 
vehicle by .which youngsters would be both motivated to further exploration, of 
octupatlons and stimulated to develop their own Individualized strategies to r, 
undertake those explorations. A brief description of the hardware, software, 
and nature of the Interactive process which was utilized In an attempt to. 
fulfill the stated objectives Is presented In the following discussion. 

The student terminal provided the means by which a student. Interacted with 
the system. The terminal, cbnnected to an IBM 1410 computer by telephone 
lines, was composed of an electric typewriter, a tape recorder, and a slide 
projector, all under computer control. The computer presented selected 
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materials to the student, who was seated at the terminal, by either typing out 
a message through the typewrft^r, displaying a particular Image on the slide 
projector, or by playing a previously recorded message on the tape recorder. 

The student transmitted^ meaningful messages to the com.puter by typing a short 
response on the typewriter. This short response required of the student was 
considered to be essential since longer typed messages would.Thave required a 
level of typing skill ndt ordinarily achieved by most ninth grade boys. 

Information related to a certain student's abilities, preferences, and 
educational plans were stored In the computer before the student began the 
Interactive phase. The student was oriented to the purposes of the system 
before he began the first session. At that time, he was given a list of 40 
occupations with corresponding codes representing his primary entry Into the 
system. The computer's first request to the student was to ask him to select 
one of the 40 occupations on the list about which he would have liked to have 
known more. After the student responded by typing an occupational code number, 
the computer typed out a short paragraph very briefly describing the occupa- 
tion. The student was then asked If he wished to find out more about the 
occupation. If the student responded positively, four operations were acti- 
vated In the following order: 1) discrepancies which may have existed 

between the students ability-preference profile and the requirements for the 
particular occupation were typed out; 2) a two-minute taped Interview with a 
worker In the occupation was played; 3) an Image was projected on the slide 
projector screen depicting the worker undertaking four . typical tasks In the 
occupation and 4) a 150 to 200-word description of the occupation was typed 
out for the student to read, and to keep for later use. 

The student was allowed to proceed through as many occupations as he 
wished during as many 40-m1nute sessions aS he cpose to Spend. We may have, 
at any point In the process. Indicated that he would have liked the computer 
to select for him those occupations from the list of 40 which he might have 
been Interested In exploring further. The computer, by comparing the aptitude-' 
preference profile for the student with the 40 occupational profiles sought 
those occupations for which no discrepancies existed. It listed those occupar 
tions for thfe student. 
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Resui ts of the Field Trials 

' In order to assess the outcomes of the field trials' a substantial amount 
of data was collected. These data included: 

1) amount of time voluntarily spent by each s'tudent with' the terminal 
(Roosevelt High School sample only); 

2) number and type of occupational tiescriptions requested by each student; 

3) reaction of each student to the equipment, the content and procedures 
utilized, as measured by a 44-item inventory; 

4) students' expectations of, the experience; their changes in awareness 
of self as related to work; the degree to which their horizons of 
occupational opportunities increased or ‘decreased; the degree to which 
students developed an exploration strategy; and the degree to which 
students were stimulated to seek additional information regarding 
occupational opportunities— all collected by way of a 30-minute 
interview immediately following the terminal experience (Roosevelt 
High School sample only); 

5) change in expressed tentative occupational choice between September 
and March for the group having the terpiinal experience as compared 
to a . similar group of vocational -technical bound boy? not having the 
experience and a group of non-vocational -technical bound boys 
(Roosevelt High School sample only); 

6) selection of tenth grade course of study as compared to previous two . 
years selections at the same school (Roosevelt High School sample 
only); 

7) changes in occupational values as measured by a 35-item inventory, 
and 

8) changes in the students' general knowledge about occupations as ^ 
/measured by a 149-item test (Keith High School sample only). 

An Wtensive analysis of the data listed here appears in the Final Repprt 
of the Phase I project (Impel 1 itteri , 1968). Because of the broader purposes 
of this paper, only summarized portions of the more significant analyses are 
presented. 
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Description of Planned Program 

A revised, mofe highly structured heuristic approach has been designed. 

The following discussion is an attempt to describe the content, sequence and 
the nature of the student's participation during the interactive process. 

The first phase of the computer terminal experience for a student requires 
him tO\ select tl/ree occupa'tions from a list of 144 occupations representing a 
reasonable sampfing of opportunities in the world of won*^. The three occupa- 
tions the student is required to select from the list represent three tentative 
occupational choices. The computer has access to 288 other occupations, some 
of which may be presented during the student's terminal experience. The stu- 
dent, however, must select from tKe list of 144. This, requirement has merely 
been conceived as a convenient starting point. . The numbers of selections, and 
stored occupations have been set rather arbitrarily. 

The next step in the program is. to check on whether any meaning can be 
translated from these three choices (elementary level of ,“occtalk“ to 
"psychtalk"). This check has been built into the program as a five-item test 
with feedback on each of the three occupations. Each of the five multiple 
choice test items have been designed to measure^ a student's knowledge about one 
of the following aspects of each of the three selected occupations: 1) duties 

and typical tasks; 2) educational requirements; 3) training requirements; 4) 
working conditions; and 5) opportunities for advancement. The feedback for 
each item is essential in that it either crystallizes the perception of the 
youngster about an occupation, or it clarifies his perception. The nature of 

the feedback takes the form of either; "Good! Your answer Is correct. 

or "Incorrect. In either case" " represents a one or two sentence 

description of the particular aspect of the occupation In question. 

The final stage in analyzing each of the three occupations is to g.ve the. 
youngster an opportunity to replace the occupation in question with another 
which might appear to be more appealing to him after finding out something 
abodt the originally listed occupation. Replacement then requires the student 
to go through the same process of questioning with the new occupation on the 
lisp. The student's score on eath five-item test, his total score, his score 
on eadh of the five areas across the three occupations, and the number of 
replacements he chooses to use are stored in computer counters for use later In 

the program. 
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Thei. proc6dur6 cofltinues dftor th6 studont has reachad the stage when he 
is relatively satisfied with the three occupations finally listed. The com- 
puter then presents the following message via the CRT: 

. "When a ninth grade boy states what he thinks are possible 
occupations which he might enter In the future, he may be 
indirectly Indicating something about those kind of acti- 
vities he likes to do. Let us examine If you have shown , 
something about ^urself In selecting the choices you listed. 



The computer proceeds to compare an Interest profile developed for each 
>of the three occupations listed based on a dlchotomc^us scale (Significant/ 
Non-significant) of each of the ten Kuder Interest Inventory dimensions. Only 
those coincidences of three occupations having the same significant dimension 
are noted for further consideration. If there are no coincidences of three 
occupations, the computer searches for two of three on any of the dimensions. 
On the basis of Its search the computer then pr^esents the following 

message: 



"In selecting the three occupations which you have listed f 
you have Indicated that you may have a preference for / 

working with numbers and a preference for working with / 

machines and tools .” \ 

The student Is then asked about each of the areas of Interest which w^ 
underlined In the message, one at a time. He Is asked. "Do you tfflnk you have 
a preference for working with numbeHl?" After the student answers yes or 
"no,” tho computer then verifies this answer on the basis of the student s 
coded (S1gn1f1cant/Non-s1gn1f1cant) Kuder scores which have been stored. It 
then feeds back Information on the accuracy of the student's perception. When 
each of the Interest areas have been presented, the student Is then asked, 

"Would you like to examine other occupations which might be In line with the 

preferences you have expressed?' \ 

If the student answers "no" to that question he Is asked to consult a 

list of the ten preference statements of the Kuder, and to Indicate his major 
preferences. These then are verified ItTthe same manner as previously described. 
All students should, whether they have answered "yes" or "no" to the question, 
reach the next step of the program. That step requires the student to consult 
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.Another list which allows him to specify further those characteristics, If any, 
.'he wishes to Impose on the following selection. Those possible characteristics 

Include;^'' ' . 

1'^ 1) Any one, two, or three of the nine aptitudes of the GATB (U. S. 

Employment Service), listed by statements like, "Ability to deal 
accurately .and quickly with numbers," etc. Each of these apti- 
tudes, If selected, by the student Is verified In accordance with 
I ^ the same procedures utilized In the verification of perceived 
Interests. 

I 2) Four areas of school achievement (mathematics, language, science, 

; social studies). These also are verified -In accordance with 

I ‘ previously described procedures. 

3) Educational level— college vs. non-college. 

4) Amount of physical activity Involved In the work^-much vs. some vs. 
none. 

5) Priinarlly Indoor or outdoor work. , 

6) Salary J4^1. 

For each of the 432 occupations In storage each of the characteristics 
above are coded In some way. This feature allows the computer to access, based 
upon the student's stated restrictions, 429 occupations ml n^ the number of 
occupational replacements made by the student. Each of the 4M-R occupations 
which are Identified by tlje computer are presented via the CRT. to the student. 
If five or fewer occupations are Identified In accordance with the student's 
restrictions, the. computer will suggest that the student pick out the least 
Important characteristic he chooses, and ellmlniste It. At the point where 
five or more occupations have been presented to the student (plus the three 
originally selected by the student) It Is suggested, that the student may wish 
to visit the library, counselor's’ office, etc., to uncover more Information 

about these or other occupations. ^ 

The final phase of the program orients the student to focus upon the 
characteristics, he selected. For Instaifce, If he Indicated no altitude area 
as being Important, he will 1>e asked to select what he feels Is the- most 
Important of the nine abilities and to note the differences between the 
' original list of occupations and the new list. He Is asked to make some 
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comment about the dlfferewe from a list of five statements presented to him. 
This technique Is also used for the achievement area as well as educational 
plans. < 

Through the kind of experiences provided for the student In this revised 
program* It Is hypothesized that he will develop a unique framework of the 
world of wqrk as well as an operational strategy In exploring his place In It. 
For ninth graders, whose entrj Into the exploratory jstage Is Immjjnent, At seems 
that such an objective |s essential, and should be an Important determinant In 
the planning and development of the total ninth grade educational’ program. 
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Geometric Dictionary 

There are at least four advantagies In using a yeometrl^c dictionary on the ; 
computer-controlled CRT display (Pel oquin, 1968.V. First, the geometric diction- V 
ary uses less core storage than a graphic set, yet there Is no llmj-t to the ^ 
number of line drawings wiTich can be made. Because the components of a diction- . 
ary are small, they become more general and may be used In many different com- 
binations. By analogy, a graphic set may be equated, to a vocabulary Of 64 
words, while the geometrip dictionary may be equated to an alphabrt of 128 - 
letters. The geometric dictionary may be equated and used vul^hln various 
courses t;hereby conserving core storage. Second, the pecesi^l^ of keypunching 
each and every one of the line drawings dot by dot -1s eTimliiateil;. ;Th1rd, the 
geometric dictionary allows the author to construct, on-Hne, the/. graphics Tor^ 
his course. This ability allows him to Instantly see the Tine drawing as 1t 1s 
entered and make necessary changes or corrections. Fourth, words and line 
drawings can be combined without the one column gap necessary when uMng a , , 
graphic set. 

There are, of course, some disadvantages as well. The' geometrl c diction- 
ary has been designed for producing moderate and large-sized line drawings. 

Except for some gross shading, such as "blackened" areas and hachures, the 
f1|ures produced with this dictionary have been only line drawings. Some conr 
straints are' placed upon the drawing by the availability and the nature of the 
line segments. This restriction necessitates, careful planning, but with the 
help of the IBM 1500 Instructional Display Planning Guide sheets 1t does not , 
constitute a serious problem^ Usually the addition of an extra character Into, 
the dictionary or a bit of programing ingerlulty wTll overcome problems 1n 
producing still or dynamic line drawings. ' 



• V 









General Description " j 

The geometric dictionary consists of line segments, entered ;as- dictionary 
characters which may be manipulated as such. Throughout this description the 



chardcters fippodflnQ on the termindl keybodrd and on the CRT under the system 
dictionary, whether letters, symbols, or numbers, will be referred to as 
"associated keyboard characters." The characters containing the line segments 
of the geometric dictionary will be refer**ed to as geometric characters, and 
the line parts contained within each of the^geometrlc characters will be 
referred to as line se^nenbs,' whether straight line segments, arcs, or special 
characters. Since we arp dealing with dictionary characters,^ once the 
geometric dictionary ha^been called by a dictionary change the geometric 
dictionary has all the operating characteristics and functions of the system 
dictionary. A particular line segment Is called and displayed on the screen 
by entering the assor^lated keyboard character In a display text (DT) or 
display text Insert (DTI) Instruction. For example: 

DT . 12,10///*! aaaaa*b*b78 a a a a a 78*b*aaaaa*e 

After a dictionary change (denoted by *1) Is made, this Instruction will 
* display the "a" as a horizontal straight line and the mmbers "78" as the left 
and right half of a small circle respectively. The backspace function (*b) has 
been used to superimpose lines. 



Procedure 



Sketching 

The procedure Involved In the construction of a line drawing regulres 
three steps: sketching,, coding, and entering. First, a sketch of the line 
drawing Is made on an Instructional Display Planning Guide. The sketches 
should be rather simple and should be constructed of those line segments that 
the prbgramer knows are available In the dictionary. On the three pages fol- 
lowing this description of the first step are reference pages Indicating the 
orlenutlons of the line segments that are presently available to the programer. 
It Is recomnended that these reference pages be reproduced In a transparent 
form In order that the programer may overlay the available line segments on 
his sketch for comparison. The reader Is reminded that each geometric charac- 
ter may be used Independently. Thus If the third (and middle) character of a 
30® line Is needed. It may be used independently of the other four geometric 
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characters which make up the completed line. If the programer cannot match his 
sketch witn an available line, he should select the closest approximation and 
revise hl 5 sketch accordingly. A limited number of special characters may be 
Inserted Into the geometric dictionary If the programer finds that their omis- 
sion seriously handicaps him. Additional flexibility can be gained by the use 
of the keyboard functions such as space, backspace. Index, reverse Index, and 
dictionary change. Superimposition, offsetting by a half-line, the display of 
text and geometric figures In Juxtaposition or superimposition, the display of 
oniy half of a geometric character, and shading are some facilities gained by 
ty^ use. of standard keyboard functions. With a little practice, the program^'s 
familiarity with the lines available In the dictionary should grow to a point 
where he will be able to produce sketches which ^j^ul re no lines that are not 
already In the dictionary. In anticipation of the second step, the programer 
may wish to make mental or written notes on the line segments he Intends to use 
In constructing the line drawing. 

Coding 

The- second step In constructing a figure with the geometric dictionary may 
take place once the sketch In the Instructional Display Planning Guide contains 
^ no lines which are not In the geometric dictionary. 

The two reference pages following. Figure 3, are used In the "short form" 
of encoding. The reader should note that the associated keyboard characters 
jfg written beside, above, or below the geometric characte?^ to which they 
refer. One simply chooses the line segment and geometric character he- wishes, 

then encodes the associated keyboard character. 

The use of the long form Is not described here since simple line drawings 
can easily be constructed with the use of the short form. Mofe complex figures 
requiring knowledge of every lighted dot within the character would necessitate 

the use of the long form. < 

c 

' % 

Entering 

The third step Involves the on-line entering of the coded line drawing. 
This step may, of course, be altered by entering the coding on cards. The 
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1 n 




V . 

4 Characters Tall 2 Characters 

/ S 

T 
U 
V 

g 2 10 





2/3 Character 




y Row Tall 



B 

A 

(? in one 
Character) 



Horizontals 

B B B 



ana. 

• • 

c d e 








Ha 1 f- Horizontals* 



0Q aa 



□ □0 0 




(zero) (times) 



t 



There are no half-horUontal lines in the position equivalent to 
the horizontal a. 



Flq. 3. Short form documentation. 
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Verticals - Short Form Documentation - (Cont. ) 



□ 0 IE III pi 01 g 0 

f . g h 1 >b c d e 



Diagonals 



f 

1 X ! 


g h i 

5 Characters (15*) 






'"1 r-' 




U V ¥ 
2 X ! 


f X y z q r s t 

5 Characters (30*) 


.1 


i k 1 m n c 

tv. 


1 



2x3 Characters (45<*) 



•• • • • • # # 

k 1 m n 




0 p 

1 X 1 Character ( 60” ) 




rrs 



0. S 



p q r 
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s t 
3 X 1 Characters (75^) 



1 X ^ Characters (35") 2x1 Characters (70") 



9 



as IS; 



Shading 



kv.i 



• • 
» 



X 



i I 






(conma) 



/ 

(slash) 



o 

ERIC 
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idvantage of entering on-line Is that thh prograiner may see the portions of the 
drawing as he enters It, thus allowing him to correct or change the coding and 
the drawing. . . 








A Processor for Multiply Humeric Entries - 
. new 1410 PwputeFISyn^ ^ 

For the sequential testing progrdh It was desired that a student be 
allowed to respof^ to multiple choice questions In the embedded tests by 
stating his subjective probability oP'degree of belief fbr each of the choices 
' presented. It was further desired that the of responding not be unduly 
time consuming or unnecessarily restricted ^nthe range of format variations 
accepted. Due to the time factor Involved ‘following each student response on 
the 1410 system, U was not desirable to have the student enter his subjective 
probability for each choice separately. If the student was to be allowed to 
enter his subjective probabilities for all choices In a single response, there 
were two possible ways of processing the response In which tte Information con- 
cerning the subjective probability fbr each choice would be preserved. A series 
or "s^ck" of possible answers could have been provided In the program against 
which to compare the student's response. However, because of the number of 
combinations of subjective probabilities possible and the permutations possible 
for each combination. It was impractical to employ this procedure. 

The alternative proc^ure (Bahn and Brown, 1968) entailed evaluation of 
each subjective probabi Mty In the student's response when the Individual pro- 
babilities were themselves components In a string of probabilities which made 
up a single ijsponse. wn «ueh capability exists In 1410 Coursewriter . The sub- 
routine described here provided this capability and was employed In the pre- 
viously referenced Instructional program. 

The algorithm fof the multiple entry* subroutine Is as follows: 
l.yihe student's response Is mtered In^the form: 

XX, XX 

XX, XX, XX, XX 

or 

XX, XX, XX, XX, XX 

where xx Is any two-digit number within the range 00 to 99 or the three-digit 
number 100.. 




* 
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2. An edit function deletes extraneous spaces, letters, and special 
characters. 

3. A series of edit functions rounds the numbers In the student's 
response to the nearest ten and converts the niinber 100 to 99. 

4. The response ^s now In the form: 

yy. yy 

yy. yy. yy. yy 

or 

yy. yy. yy. yy» yy 

where yy Is a member of the set of numbers (00, 10 , 20 , 30 , 40 , 50 , 60 , 70 , 80, 
90, 99). 

5. Response processing now enters a series of twenty-two (22) to fifty- 
five (55) Initial character function (1c fn) calls depending upon the number 
of entries (2, 4, or 5) and the values of the entries. The Initial character 
function allows one to compare n Initial characters of a response and .to 
Include "don't care" characters (In this case $) which will match any single 
character In the string of characters which Is to be matched, I.e., "wild" 

cards In poker. 

6. The first set of Initial character functions compares the first 
three (3) characters of the student's response with answers of the form: 

yy 

7. The second set compares the first seven (7) characters of the 
response with Answers of the fOnn: 

$$. yy 

8. If only two (2) entries were required, processing passes to step 13. 

9. The third s^ of functions compares the first eleven (11) characters 

with answers of the .form: 

$$. SS. yy 

10. The fourth set couqMires the first fifteen (15) characters with 

answers of the form: X 

$$, $$, $$#yy I 

11. If only four (4) entries were required, processing passes step 13. 
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12. The fifth set of functions compares the first nin teen (19) charac- 

/ 

ters with answers of the form: ‘ 

$$, $$, $$, $$, yy 

13. Each time an entry was matched. Its value (yy) was placed in a 
counter corresponding to Its original position in the total response. These 
counters ere noN added together to see If their total 1$ one hundred (90 to 
110 to allow for rounding error). 

14. The entry with the highest value is loaded into couilter six (c6) and 
a switch is set to indicate the original position of this value. 

15. Control is returned to the main program. 

With the the advent of the IBM 1500 instructional system and the extract 
integer function (er fn) this same procedure can be implemented with fewer 
statements and greater accuracy. A macro has been written to accomplish this 

task. 
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CHARIER VI 
RESEARCH STUDIES 



\ 



Relationship A mong Attitude . Achievement, and 
Ap iude Heasures anJ Performance 

Purpose ^ 

The main objeetive of .the Investigation (Hodtke, 1965) was to examine 
relationships among academic aptitude, past achievement, and performance n CM 
to determine whether the results of previous Investigations can be generallied. 

Methods and Procedures . 

Forty-f1»e college students completed a section of a course In modem 
mathematics which was presented by means of computer- teleprocessing. The stu- 
dent terminal consisted of an IBM 1050 cooaminlcatlons system consisting prt-^ 
wrlly of an electric typewriter as an Input-output device. The frames of the 
program were typed out to the studenU at the Wewrlter. and the students 
entered their responses by typing them at the terminal . Responses were evalu- 
ated by the computer which kept track of the studentt' performance by accuaw- 
latlng their errors and response latencies In counters. These error «d 
response latency daU were later retrieved by means of a Stude nt Regrds pro- 

gram developed by IBM computer scientists. . . .k.,. 

Each student was scheduled for a three-hour Instructional session. 
arriving at the CM laboratory, each stu^t was pre-examlned on his know edge 
of the content of the modem mathematics program. The student was then given 
a warm-up period to famlllarlie himself rrt.th the operation of the studmt 
terminal. Following the warm-up period, each student completed a section of 
the modem matheamtlcs course on n«d>er systans with bases other than ten. 

Host studentt coapleted the cours. In about 2 to B 1/2 

Mined instruction In bese eight, base f1*e. and base two mmdrer systems, a 

transformations fro. one base to another. The modem arth^les eoume has 

been found to be fairly difficult for the average c^e 

few students exhibit prior knowledge of the conceptf'as Indicted ^ 

performance on the pretest. Following completion o*. the course, students were 
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given • criterion measure of their achievement In the course, and responded to 
a number of attitude scales modeled afttr the Semantic Pifferentlal . scales 
(Osgood, Suci and Tannenbaum. 1957) . The criterion achievement test was found 
to have a test-retest reliability (one-week Interval) of 93 In an earlier 
study by Hodtke. MltzeT. and Brown (1965). The attitude scales were designed 
to measure the students' reactions. 

Sunwary ' 

The results of the present Investigation may be s«war1k.ed as follows: 

^ }) The present resulU do not egree with the results of several previous 
Investigations whicrt found nonsignificant relationships between achievement In 
programed Instruction and measures of general Intelligence. Significant corre- 
lations were obtained between Scholastic Aptitude Ten scores and a criterion 
measure of achievement In modem mathematics presented by c«:)puter-ass1sted 
instruction. Although It may be reasonable to expect Individualized programed 
Instruction to reduce Individual differences In s^dent achievement In some 
content areas, student performance In other content areas may depend on /sq- 
ulslte skills and abilities which have deep roots In many years of previous 

training. 

2) Cumulative college grade point average was found to correlate signi- 
ficantly with modern mathematics achievement level prior to CAl Instmctlon, 
but did not eorpolnte tignificontly with po$t-1nttnietion achievement level. 
This result suggests that grade point average reflects the amount of prior 
achievement, but Is not a good, predictor of how aaich a student will leam In 

Short periods of Instruction via CAl, 

3) The best predictors of student errors made during CAl were SAT-M, 
SAT-V, C6PA, and response latency In that order. The results suggest that the 
latency of a student's response might be used as a s1gnal*‘to the computer to 
present remedial Instruction and thereby, prevent the occurrence of an Incorrect 

response. 

4) A measure of the students' attitudes towards CAl Indicated that 
college students generally reacted favorably to the exj^rlence. However, men 
tended to react more favorably than women, and/ high-aptitude .students tended 
to react more favorably than low-aptitude students. 
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5) Nonsignificant relationships were obtained between attitude towards 
CAI and performance in the course when the effects of aptitude were. parti aled 
out. 



Scrambled vs Ordered Course Sequencing 

Purpose 

i % 

The primary purpose of this Investigation (Vfodtkei 1965) was to determine 
the Interaction between student aptitude and scrambled vs ordered sequencing of 
Instruction. t(»1s study employed a fairly lengthy Instructional program of 
considerable difficulty for the average college student. The material used 
Involved the learning of principles, mathematical problem solving, and contained 
,,a large number of sequential dependencies among the concepts taught. The 
specific objectives and predictions of the experiment were as follows: 

1) To determine under what conditions careful sequencing of Instructional 
programs "make a difference" In student learning within the context of computer- 
assisted Instruction. Following appropriate hypothesis tests. It was pre- 
dicted that scrambled Item sequencing would have a detrimental effect on stu- . 
dent learning In a relatively lengthy, difficult program conUlnIng many 
sequential dependencies among concepts, e.g., when the mastery of some concepts 
and principles are prerequisite to the mastery of other concepts and principles. 

2) To determine whether scrambled as compared to ordered Item sequences 
have a differential jef feet on students of high- as^compared to low-verbal • 
aptitude. An aptitude by sequencing Interaction effect was predicted. Scram- 
bled Item sequences were expected to have a more detrimental effect on the 
learning of low verbal ability students than on the learning of high verbal 
ability students. It was thought that students of low-verbal ability would not 
have the conceptual skills required to reorganize the scrambled material. 

Hethods and Procedures 

The course used was a section of a modem mathematics course^ w^rlch ^ 
been developed for CAI by the staff of the Computer Assisted Instruction Labora- 
tory at Penn SUte. The matoHal selected contains Instruction on tto use of 



number systems with bases other than ten. This learning task offers the 
advantage of being relatively difficult for college students to learn, and the 
material Is unfamiliar to most students. The ordered version of the program 
presents subsets of Items In the following sequence: review of the base ten 
system; the concept of place, value; the application of the concept of place 
value In base eight, base two, and base twelve minber systems; transformations 
from one base to another; addition and subtraction In numbers systems with 
bases other than ten; and multiplication and division In number systems with 
bases other than ten. Previous experience with these course materials Indi- 
cated that most undergraduate college students could complete Instruction In 
approximately two and one-half to three hours with a mean error rate of about 
fifteen percent. 

Pifty-one undergraduate students In an educational psychology course at 
Penn State served as the In the Investigation, ^s with absolutely no pre- 
vious typing experience were not Included In the study. Two Ss were eliminated 
because a modem mathematics pretest Indicated they had previous knowledge of 
number systems with bases other than ten. One other ^was eliminated because 
his scholastic aptitude test scores (SAT) were not available. These elimina- 
tions brought the total number of Ss to 48. ^ 

Subjects w e r e then subdivided Into high- and low-aptltdde groups on the 
basis of their sd>res on the verbal Scholastic Aptitude Test (SAT). The meag 
of the high group was 612 and the mean of the low group was 534 (SAT employs 
standard scores based on a mean of 500 and a standard deviation of 100). The 
original plan of the Investigation was to assign Ss within each of the high 
and low aptitude groups at random to the acrambled or ordered Instructional 
treatment conditions. Although approximately half of the Ss were assigned to 
treatments at random, the random assignment of a large rnanber of Ss had to be 
altered due to a number of programing "bugs" which developed at the last 
minute In the scrambled sequence program. For this reason, a largdr nianter of 
Ss who were scheduled for the early experimental sessions were run In the 
ordered s^uence condition, and a larger number of Ss scheduled for the later 
experimental sessions were run In the scrambled sequence condition. The 
Investigator had carefully examined the two groups of subjects and In spite of 
the nonrandom assignment Of some of the Ss, can find no selective factors which 
could account for the results obtained In the study. 



The dependent variables of the study were criterion test performance, 
errors made In the program, total time taken to complete the program, mean 
response latency per frame, an efficiency score obtained by taking the ratio 
of criterion test performance to Instructional time, and measures of the stu- 
dents' attitudes towards CAI. The data^were analyzed by means of a two by two 
factorial analysis of variance design with unequal numbers of cases per subcell v 
One experimental factor consisted of high versus low aptitude; the other of 
scrj^led versus ordered program sequence. 




Result 
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‘A preliminary analysis Indicated that although the high- and lowaptitude 
groiips differed significantly on the verbal SAT measure, the scrambled and 
ordered siMiMopce gfoups did not differ significantly In verbal ability as 
measured by the/^AT.* In add1t1on\ an analysis of quantitative SAT scores pro- 
dute'd nonsignificant differences among the four treatment groups employed In 
the study. 

The distributions and tKfe variances within groups of the dependent vari- 
ables were examined to determine whether the assumptions underlying the analy- 
sis of variance had been met. None of the distributions appeared to deviate 
substantially from normality. Hartley's Wimum F-ratios were computed to test 
the assumption of homogffielty of variance. All of the F-ratios were .nonsigni- 
ficant except one. The F-ratio for tfe efficiency -score was significant at 
less than thq .01 level Indicating ^ presence of heterogeneity of variance 
for this variable. In view 'of the results obtained by other researchers who 
found that heterogeneity of variance did not seriously bias either the t-test 
or F-ratio, the heterogeneity of variance for the efficiency score cduld not 
have seriously biased the result^ obtained In the present study. 

In general, the results of the analysis of the main dependent variables 
of the study confirmed the initial expectations. The results Indicated that 
students in the scrambled sequence group made significantly more errors during 
Instruction than the students in the ordered sequence group (P <^.001)*. Since 
the students in the scrambled sequence group were more llkqly to encounter 
remedial segments of the program (due to th^lr greater tendency to*make errors), 
than the students in the ordered group, the scrambled sequence group actually 
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responded to more questions than the ordered sequence group. The differences 
"obtained in the total frequency of errors might have resulted from the fact 
that the stiidents In the scrambled group simply responded to more questions 
and thus had more opportunity to make errors than the ordered group. To 
control for this possibility, an analysis was als'o computed based on percent 
error scores. This analysis indicated that students In the scrambled sequence 
group made a significantly greater percentage of errors than the ordered 
sequence group. In spite of the highly significant sequencing main effect for 
frequency and percentage of* errors, the sequencing main effect for the crite- 
rion test score was nonsignificant. Cons'idered together, these results Indi- 
cated that although the scrambled sequence students made significantly more 
errors during Instruction than the ordered sequence S^s, they apparently 
Improved their performance during Instruction and, by the end of the course, 
they performed approximately at the same level as the ordered group on the 
criterion measure. 

The data Indicated that the predicted aptitude by sequencing interactions 
were obtained. The Interactions for frequency of errors and the criterion 
measure were both very close to significance at the .05 level. However, the 
Interactions which were obtained for several criterion variables did not 
result from a decrement In the performance of the low-aptitude group In the 
scrambled program as precicted , but from a decrement In the performance of the 
high aptitude S^s In the scrambled program. The results of the present study 
support the conclusion that scrambling an Instructional program has little or 
no effect on the performance of low-aptitude students, but produces a rather 
marked decrement in the performance of high-aptitude students. 



Rote Rule-learning on Transfer of Training 

Major Objectives 

1) By means of an experimental paradigm which simulated a common class- 
room teaching sequence, the study attempted to demonstrate the detrimentatl 
effects of adding rote rules-of- thumb to instruction designed to facilitate 
basic understanding and transfer of training. ' 
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2) , The study also compared the effec^ on transfer of two rule practice 
sequences, one In which the rule was glve^after Instruction but before a 
practice segment, and another In which the rule wus given following both 
Instruction and practice (Logan and Wodtke, 1966). (See Table 1 for the 
sequence of experimental events.) 



Table 1 

Experimental Sequences 



Condition 1 (No-rules) 


Condition II 


(Rules-early) 


Condition III (Rules-late) 


Pretest 

1 


Pretest 

1 


Pretest 

1 


▼ 

Basic Instruction: 


▼ 

Basic Instruction: 


▼ 

Basic Instruction: 


Significant Figures 


Significant Figures 


S1gn1 ficant Figures 


In Multiplication 
1 


In Multiplication 

1 


1n Multiplication 
1 


▼ 

Practice Problems 


▼ 

Rule Given for 


▼ 

. Practice Problems 


1 


Mul t1pl1cat1on 


1 


▼ 

Transfer Posttest: 


Practi ce 


Problems 


▼ 

Rule Given for 


Addition and 
Trigonometry 


\ 


f 


Mul t1 plication 

i 




Tran*?fer Posttest: 


Transfer Posttest: 




Addition and 
Tr1 gonometry 
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This comparison was designed to test the hypothesis that the addition of 
a rote rule-of-thumb to an Instructional program which strives for under- 
standing win. If It comes before the student is given a chance to use his 
basic understanding In practice problems, produce a decrement In performance 
on transfer tasks. 

Another phase of the Investigation examined th'e hypothesis that a condi- 
tion In which a rule was given before practice would have a more detrimental 
effect on transfer than a cono1t1on,1n which the rule was given after practice. 
This hypothesis was based on the supposition that students would, if given the ' 
rule before the practice problems,' practice using the rule, and ^ould not 
exercise the problem-solving strategies developed In the basic Instruction. On 
the other hand, students who did not have the rule available until after the 
practice session would be forced to solve the practice problems using the under- 
standing of significant figures which was developed by the basic program. This 
hypothesis was not confirmed. 

Conclusions 

1) The presence of a rote rule-of-thumb In an Instructional sequence 
designed to facilitate transfer to problems which were not specifically taught 
In the program, and to which the rule did not apply, produced a marked decre- 
ment In performance on the transfer tasks. The decrement on the transfer tasks 
was obtained by comparing an Instructional program containing a rote rule-of- 
thumb with an Identical program containing no such rules. The transfer decre- 
ment occurred In spite of the fact that the students were given a didactic 
warning Indicating that the rule would not apply on the transfer problems. The 
results of the study Indicate that didactic verbal warnings to students have 
little effect on their behavior In an actual transfer situation. The authors 
believe that the results of the present study are fairly typical of actual 
classroom teaching practice, and that much .more care should be taken In pre- 
paring Instruction which Involves the use of rules-of- thumb In problem solving. 

2) the present results Indicate thaft It makes little difference whether 
the rule-of-thumb precedes practice or follows practice. In either case the 
presence of the rule inhibits performance on transfer tasks when compared to a 
group taught without the use of rules. For example, If one examines the 
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percentage of naive students In each experimental group which reached "mastery" 
on the addition transfer tasks, mastery being defined as perfect performance, 
one finds that only 20% of the rule-late group, 20% of the rule-early group, 
but 75% of the no-rules group reached mastery! 

3) A supplementary examination of the responses made by the students in 
the transfer tasks Indicated that the poor performance of the rule-groups 
resulted to a considerable extent from their misuse or overgeneralization of 
the rule. The misuse of the rule occurred even though students had been warned 
several times concerning the Inapplicability of the rule to the transfer situa- 
tion. 

The writers do not take the present results to indicate that computational 
rules or algorithms should not be included In quantitative Instruction, *but 
only that teaching students to use such rules appropriately requires special 
Instructional procedures which are frequently omitted In actual practice. The 
apparent tendency of students to overlearn a simple rule-of-thumb at the expense 
of their basic understanding of the processes Involved would seem to Indicate 
that much more care should be taken in the preparation of Instructional 
materials designed to produce basic understanding and transfer of training. ^ The 
results of the present study are probably most easily Interpreted as a case of 
the students' failure to discriminate problems in which the rule applies from 
problems In which the rule does not apply. Perhaps the optimal Instructional 
program would provide the basic understanding, useful problem solving rules, 
and the discrimination' training needed to help the student avoid instances of 
rule misuse. Most Instructional situations do not provide the discrimination 
training necessary to reduce the frequency of rule misuse. It Is quite evident 
In the present results that this objective is not achieved by simple didactic 
verbal statements. As a general recommendation for teachers In quantitative 
subjects. If simple rules-of- thumb are to be taught, much discrimination 
training In the use of the rules will probably be necessary In order to avoid 
the students' tendencies to blindly apply the rules without regard to the 
appropriateness of the situation. 

Although one might presumably argue that the present results Indicate 
that rules-of- thumb should be avoided In quantitative Instruction .altogether, 
there are obviously many problem solving situations in which such rules have 
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great utility. Ideally, a student should be able to capitalize on the 
Increased efficiency provided by the. rules In problem solving, but he should 
also be able to select the appropriate rule for a particular problem, and be 
able to rely upon his basic understanding of the processes Involved when he 
recognizes that no existing rule applies. 

Educational Variables 

\ 

Purpose 

The primary purpose of the present study (Gilman, 19^6) was to compare an 
Instructional program prepared by means of IBM's Coursewriter language for CAI 
presentation with a more conventional programed text. The feedback, prompting, 
and correction procedures available In the Coursewriter language were expected 
to produce Increased student motivation, attention, achievement, and retention 
over time. The branching and decision-making capability of CAI was not examined 
In the present study, ^ 

Method 

Subjects . The subjects were 66 ninth and tenth-grade students In the 
college preparatory curriculum at State College Junior High School. All were 
naive with respect to educational experimentation procedures and none had 
received Instruction In physics. All Ss who began the experiment completed the 
experiment. 

Design . Subjects were randomly divided Into three groups. The randomiza- 
tion was accomplished by the use of a well -shuffled stack of student data cards. 
S^s were pretested with the ten-question pretest. No S^ answered more than 3 
questions correctly and most answered all responses Incorrectly. 

Two of the groups received Instruction by CAI programs. The first of these 
(CPF) received contingent feedback and prompting and students were required to 
answer the Item correctly before proceeding. The second group (KCR) received 
Instruction by means of a CAI program providing a statement of the correct 
response. The third group (text) received Instruction through a programed text 
containing material and feedback Identical to that of the KCR program. In all 
three groups, the Instruction was completed In a single lesson. 
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All Instruction was "stand alone" Instruction in that no other Instruction 
was provided other than the programed course. There were no difficulties with 
any of the equipment used during the experiment and the CAI groups experienced 
no down time or delays. 

Conclusions 

< — : 

The major conclusions of the study may be summarized as follows: 

1) No differences In learning and retention were obtained for a CAI pro- 
gram which Incorporated response-contingent feedback, prompting, and overt cor- 
rection procedures on the part of the student when compared to a CAI program 
which simply typed the correct response following a student response and pro- 
ceeded to the next frame. 

2) No differences In learning and retention were obtained for a condition 
In which an Instructional program was^ administered, by a teletypewriter communi- 
cation device as compared to a condition in which the material was presented by 
means of a programed text. 

3) The conditions In which Instruction was presented by a CAI communica- 
tion device took significantly more instructional time than the programed text 
condition. 

The results of the present study appear to be consistent with the results 
of Swets (1962), Swets, Harris, McElroy, and Rudlow, (1964), and Stolurow and 
Davis (1960). Shurdak (1965), however, employed an Instructional program which 
contained branching to adapt to the Individual learner, diagnostic and drill 
questions, and c^puter-controlled and optional review. Shurdak's more 
adaptive program probably accounts for the superiority of his computer-based 
Instruction group over programed and conventional text groups. The present 
study did not examine the branching question, but only compared different 
strategies for correcting student errors and providing feedback to the learner. 
The present findings bear on the question of the nature of feedback and cor- 
rection procedures. These results tentatively suggest that less elaborate and 
straightforward feedback and correction procedures may be as effective as the 
more elaborate prompting, response-contingent feedback, and overt correction 
procedures. 
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Typewriter Interface /\ 

Nature and Purpose 

of the Study 'i 

For Individuals not familiar with CAI terminology, the term interface 
(Wodtke and Gilman, 1966) refers to the input and output devices through which 
the subject matter is presented to the learner and through which the learner 
makes his response. The interface might include auditory communication devices, 
visual communication devices varying in sophistication from simple slide pro- 
jectors to CRT displays, two-way typewriters of the type currently (circa, 1966) 
in use at Penn State, etc. 

In discussions of the interface between student and subject matter in CAI, 
the typewriter usually draws a substantial amount of time. Some of the disad- 
vantages which have been attributed to the typewriter interface are "penalizes 
the nontypist," "inappropriate for use with young children," "too slow in trans- 
mitting information to the student," etc. Some of the advantages ascribed to 
the typewriter interface have been "provides for constructed response," "permits 
remote teleprocessing," "provides hard-copy for the student," and so on. Some 
of our preliminary research raises some questions concerning the efficiency of 
the typewriter interface. 

Several studies are presently being conducted on various problems related 
to individualized instruction. Two of the studies provide preliminary data on 
the efficiency of the typewriter as a communication device for high school and 
college level instruction. Table 2 presents part of the data of one study 
which compared equivalent instructional materials presented "on-line"^ and 
"off-line" in the form of a programed text. This comparison is shown in rows 
A and B. Row C contains a condition we call a "linear coursewri ter" program 
administered "on-line." This program differs from A and B in that each frame 
contains several prompts and cues designed to elicit a correct response from a 
student who initially makes an error. Condition D, a branching coursewri ter 



^"On-line" in the present context means that all instruction was taken via 
CAI at the typewriter interface. "Off-line" means that the course was taken 
in the form of a priigramed text. 
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Table 2 

Comparison of Mean Posttest, Retention Test, and 
Instructional Time for On-line and Off-line 
Instruction In Technical Physics 
(High School Student Sample) 



/• 


Pretest 


Posttest 


- 

6-week Retention 


Mean 

Instructional 
Time (minutes) 


(A) Linear Programed 
text (off-line) 
(n - 22) 


1 .06 


20.6 


17.0 


42 


(B) Linear Programed 
text (on-line) 
(n » 22) 


1 .09 


20.0 


15.3 


52 


(C) Linear Coursewriter 
Program (on-line) 
(n = 22) 


0.91 


21 9 


17.9 


68 


(D) Branching Coursewriter 
Program (on-line) 


- 


- 


- 


- 




n. s. 


n. s. 


n. s. 


P <.001 



program, was Included In Table 2 to Indicate the direction of future research. 
Through condition D we eventually hope to produce a program which adjusts 
Instruction to relevant Individual differences among learners to produce maxi- 
mum achievement In a minimum amount of Instructional time. The subjects In the 
study were high school students. The Instructional program was relatively 
"pdnverbal," consisting primarily of short questions and verbal communications. 

Table 2 shows that although the posttest and retention scores were non- 
si gnificantly different for the three groups, that the variations In Instruc- 
tional time were highly significant. The time lost by ^administering the same 
material via the typewriter Interface was 10 minutes. (If two extreme subjects 
are eliminated from the "off-line" group the mean time drops to 35 minutes.) 
Comparing conditions B and C Indicates "that we lose another 17 minutes by 
adding prompts and by requiring the student to produce the correct response by 
typing It Into the machine. 
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Similar data from- another study using a small .sample of college students 
and a program with longer typed questions and messages obtained a mean time 
"off-line" of 51 minutes (n = 8) and a mean time "on-line" of 80 minutes 
(n » 7). Several of % students in the "on-line" group took a short five-item 
pretest and five-item posttest which is included in their time, however; an 
adjustment for this additional activity still leaves a rather substantial time 
difference. 

These time differences can be reduced to some extent by programing to 
eliminate a number of typewriter carriage returns which are currently built 
into our programs (each taking approximately 1.3 seconds). The time differences 
may also be reduced after students have had more experience working with the 
typewriter terminal and are able to operate it more rapidly. However, some 
portion of the time loss is undoubtedly due to the large difference between 
the typeout rate of the typewriter (approximately 120 words per minute) and 
the reading speed of the typical high school or college student. The average 
highly verbal student appears capable of assimilating information. at a rate 
considerably faster than can be conmunicated to him through the typewriter 
interface. Obviously the instructional time lost will be greater for subject 
matter which is highly verbal in nature, and for highly verbal students. It is 
impossible to estimate the exact extent of the time loss for different subject 
matters at the present time. Admittedly, our data require replication with 
larger samples of students and different subject matters. However, in an area 
of research where instructional manipulations generally produce only small 
gains in student .achievement, a time loss of the order of 25 percent represents 
a substantial amount. Students could be given 25 percent additional practice, 
instruction on new material, practice on transfer problems, etc. In addition 
to the gains in student learning which might result from a more efficient use 
of instructional time, there are also economic considerations in the cost of 
computer time, tie-lines, and other "hidden" costs involved in the preparation 
of the courses. All other things being equal, by employing an interface which 
would increase the amount learned per unit of time by say 25 percent, four 
students could be taught for every three taught by means of a typewriter. 

It is also important to realize that from the college student's point of 
view, learning at a typewriter terminal is not self-paced instruction since he 
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must slow down h1s normal rate of work - Pacing instruction below a student's 
optimal rate could produce boredom, negativism, and avoidance of CAI as an 
aid to learning. This is not an. uncommon finding when the pace of classroom 
instruction by the lecture method is too slow for the brighter students. . 

What are the possibilities for speeding up instruction using a typewriter 
interface? We have considered the possibility of putting all lengthy, typed 
communications, and possibly all st'm^'ius materials on slides for more rapid 
presentation to students. Two factors weigh against this proposal: a) the., 

slide production and duplication problem becomes immense for any full length . 
course used with a number of students simultaneously; b) the presentation of 
questions, problems, and other messages v a the slide projector leave the stu- 
dent with no hard-copy as a record of his work. It would be much simpler to 
put all course materials in a display book and use the typewriter solely to- 
direct the student to a particular question, problem, or' display, and as a 
response input device. Following this strategy, the ,CAI system would not be 
used to display instructional material, but to evaluate student responses and 
to refer the student to appropriate display materials according to his progress 
in the course. 

Another question which is frequently raised concerning the typewriter 
interface is the extent to which typing ability affects student performance. 

In the first study described above, students were identified as typists or non- 
typists on the basis of interview data. A comparison of the posttest achieve- 
ment and retention scores of typists and nontypists showed no statistically 
significant differences. This finding is not surprising since the responses 
required in most of our programs are relatively short one-word or at most two- 
word responses. However, as might be expected, typing ability does appear to 
relate to the time variable particularly when the program requires much Inter- 
action between the student and the subject matter through the typewriter inter- 
face. Table 3 shows the mean times for typists and nontypists in programs B 
and C. Program B was the linear program which required only one response per 
frame; program C was the course which was programed to anticipate student 
errors, and to elicit a correct response by meins of successive prompts. The 
time difference for typists and nontypists was 2 minutes on the average for 
program B, and 12 minutes on the average for program C.‘ 
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Table 3 

Typing Ability and Instructional Time (In minutes) 
at the Typewriter Interface . 





^ Program B 


Program C 




n = 14 


n = 10 


Typist 


Mean Time = B1 


Mean Time = 64 




n » 8 


n « 12 


Nontypist 


Mean Time = 53 


Mean Time * 76 



Tentatl ve Conclusions i 

1) On the^asls of preliminary €^^idence t e two-way typewriter does not 
appear to be the most efficient interface for transmission of highly verbal 
infopation to highly verbal learners, pie typewriter Interface transmits 
Information at a rate considerably slower than the reading rate of typical high 
school or college students. 

2 \ The typewriter Interface woiild seem to be iTiore appropriate fdr rela- 
tively nonverbal content areas and for students who normally work at a fairly 
slow pace. 

‘ 3) The typewriter In CAI might be used more efficiently as a response 
entry device rather than as a device for communicating ^ subject matter. 

4) The typewriter interface has the advantage of r'emote teleprocessing and 
makes available a printout of the Instruction for the student. 

5) Perhaps the optimal interface for highly verbal material, and highly 
verbal learners will be a rapid visual display device such as the CRT, with 
remote teleprocessing capability, and the ability to store, and later print out 
at the request of the student, a record of his exercises and actual responses. 
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Purpose 




Gradient- and Full -Response Feedback 
in Computer-Assisted instruction 



It Is appropriate to scrutinize the particular characteristics of a given 
system to determine whether or not there can be or 1s Improvement 1n learning. 
Many of these characteristics or variables cannot be judged In terms of pre- 
vious experimentation In the field of educational psychology because they exist 
onl^ 1n CAI. Further, studies conducted In laboratory situations cannot be 
readily transferred to an educational environment. This study (Hall, Adams, 
and Tardibuono,' 1967) attempted to remove one learning experiment from the 

r 

artificial world of animal laboratories and nonsense syllables and to place 1t 
. 1n an educ^lonal context. 



Method 



Programs were written for Investigating the effectiveness of these two 
kinds of feedback - gradient- and full -response feedback. A pa1red-assoc1ate 
learning task was employed using fifty pairs which the student learned. The 
fifty state names of the United States were presented as stimulus Items, and 
the student learned to respond with the names of the capitals. The Items were 
presented Individually, 1n random order, to the student at tHb typewriter 
terminal. If the student responded correctly (acquired) on h1s first attempt 
to that stimulus, It would be dropped from the program. The program recycled 
until each student had responded correctly on his first attempt to each of s the 
Items during one cycle. . The number acquired on the first cycle through the 
program was used as a pretest score. After the student acquired each of the 
fifty pairs, the entire 11st was presented as a posttest. A retention test was 
administered to each student two weeks after the Initial treatment. The pro- 
gram for each of the experimental treatments contained the following features: 

1. A 11st of warm-up Items consisting of five foreign countries 
presented as stimuli and their capitals as response Items. 

2. A typing test which recorded the student's time and accuracy 
1n typing an alphabetic sentence consisting of 74 computer 
characters. 
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3. A progress report to the student after each cycle consisting 
of: 

a. total number of responses;' 

b. total number of stimuli presented; 

c. total number of Items acquired; 

d. total response latency; 

e. current clock reading. 

4. An automatic 5-m1nute break approximately halfway through 

the task. \ 

5. An automatic connection to a system-administered student 
opinion survey (SOS) regarding CAI. 



Subjects 

On the basis of variability data collected during a pilot study, It was 
estimated that a minimum of ten subjects In each experimental group would be 
needed for statistical purposes. A total of 24 students from the Williamsport 
Area Community College and the Altoona Campus of the University were Included 
In the study and were randomly assigned to the experimental treatments. 

Proctors who administered and supervised the students at these locations were 
given ^specific Instructions to read to the students participating In the study. 

CAI proctors from the two campuses solicited volunteers to participate In 
the experimental study. The students were told that the study would require a 
maximum of four hours and that they would be paid a flat rate of $5.50 regard- 
less of how much actual time It took them to complete the study. The students 
were randomly assigned to one of the’ e>^per1mental treatments. The proctors 
assisted the students with the Initial registration procedure. The students' 
typeouts were returned to the course authors for analysis. 

The following, summarizes the variables and their parameters which were of 
concern In this study: 

■ 

1. Pretest, posttest, and retention tests:, all contained the same 
1tems--the names of the 50 states of the United States with a 
possible high score of 50 and a possible low score of 0. 

2. Total number of stimuli presented: fifty st1mul1(state names) 
were presented to each subject on the first cycle through the 
material. ThosO to which he responded correctly on his first 
attempt were not presented again. Those to which he responded 
Incorrectly were retained and presented again during the next 
cycle of the program. The minimum number presented was 50; the 
maximum was unlimited, determined by each subject's perfomlance. 
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3. total number of responses during Instruction: each time a stimulus 

was presented a response was required from the subject. Feedback 
was presented after each Incorrect response and additional responses 

- were required until the correct response was made. The minimum 
number of responses was 50; the maximum was unlimited but based qn 
each subject's performance, 

4. Total Instructional time: Includes the elapsed time from when 

the first Item was presented until the final correct response was 
made. 

5. Student opinion survey: a 20-Item multiple choice questionnaire. 

Each response was weighted fro 5 h five to one to produce a maximum 
score of 100 reflecting a strong favorable attitude toward CAI . 
or a minimum score of 20 reflecting a strong negative attitude 
toward CAI . 

6. Response latency during Instruction, posttest, and retention test: 
After each stimulus Item was presented a green PROCEED light turned 
on. The PROCEED light remained on until the subject pressed the 

EOB key to record his response. The time Interval that the PROCEED ,1 
light was op was recorded as the response latency for that Item. 

The sum of these Intervals was the total response latency accumu- 
lated during Instruction, the posttpst, and retention test. 



Findings 

There was very little difference In the two treatments based upon all of 
these criteria except total Instructional time. Although there Is some differ- 
ence In the total number of states presented, there Is virtually no difference 
In the total number of responses made jn each experimental treatment. This 
means that In the gradient feedback treatment the student was responding more 
often to the same stimulus, but It was not necessary to present the stimulus as 
often as was required for the students In the full -response feedback pr^gral(i. 

An adjusted analysis of variance using the pretest scores as a covariant 
was performed on total Instruction time. The pretest correlated -.847 with 
total Instructional time. The analysis produced an F-ratIo of 15*3 which was 
significant beyond the ,01 level. For the analysis of the postte'st data, the 
pretest scores and the typing scores were used as covariants In in analysis of 
covariance. A Kuder-RIchardson formula 20 reliability estimate of .725 was 
found for the posttest. The pretest cprrelated .468 with the pdsttest; the 
typing test correlated .403 with the posttest. The adjusted analysis of 
variance for the posttest scores resulted In an F-ratIo of less than unity. 



An adjusted analysis of variance was also performed on the retention test 

scores (Kuder-RIchardson formula 20 reliability estimate of .893) using the 

posttest and the typing test as covariants. The po:ittest correlated .675 with 

the retention test, and the typing test correlated .592 with the retention test. 

This analysis resulted In ah F-ratIo of 1.44, not significant at the .05 level. 

» 

Conclusions 

« 

Although the treatment comparisons did not show statistically significant 
differences In learning, there was a very strong difference In Instructional 
time for the two treatments. The response latencies also show rather striking 
differences between the two treatment groups and hold some promise for directing 
future research. The anticipated advantage for gradient feedback over.full- 
response feedback did not materialize In ''this study. We are well aware that 
additional Investigations will be required before discarding the theoretically 
sound Idea of providing learners with a graduated feedback. 

Because of the problems encountered with remote locations It was not con- 
sidered advisable to engage In further statistical analysis of the data although 
they do suggest a trend. Sllberman, Melaragno, Coulson, and Estavan (1961) 
conjectured that some measures such as response latency are more appropriate 
than error rate for making certain decIslons/’Wlthln a program. Postman and 
Egan (1949) point out that reaction time remains a sensitive measure of the 
readiness of an organism to respond. Using data of this kind has blways been 
a difficult process because of the technical problems Involved In measuring 
response latency and feeding the Information back Into the operating system for 
decision-making purposes. However, with the development of computer-assisted 
Instruction and the speed and flexibilities of such systems, this- Information 
Is readily available and can easily be used for making such decisions. It Is 
the Intent of the authors to continue Investigating these variables which seem 
to hold promise for Improving learning with computer-assisted Instruction. 
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A Comparison of the Effectiveness of Five Feedback Modes 
In A Computer-Assisted Adjunct Au^-TnsTructlon Program 

Rationale 

Intuitively, It seems probable that the correction of errors In a program 
should be beneficial to the student and that an efficient mode of feedback for 
correcting errors can be developed. This study used materials designed to teach 
widely misunderstood general science concepts (Gilman, 1967). Errors made by 
the subjects occurred as a result of misconceptions they had acquired In pre- 
vious conventional Instruction. It was thus possible to correct Ss' errors 
without teacKIng them erroneous material and without Intentionally tricking 
them Into committing errors. 

Subjects 

Subjects for the study were 75 students In teacher preparation curricula 
(science teaching excluded) at The Pennsylvania State University. Ss were 
students In audio-visual classes and had no previous experience with computer- 
assisted Instruction. 

Materials 

An adjunct auto-instruction program was prepared to teach commonly mis- 
understood general science concepts. The frames of the program were multiple- 
choice Items. One response to each Item was a correct response, one response 
to each Item was a common misunderstanding of the concept, and the other two 
responses were plausible distractors. 

The program caused all of the Items to be presented on the first Iteration 
and all Items missed on the first Iteration to be repeated on the second Iter- 
ation; all Items missed on the second Iteration to be repeated on the third 
Iteration, until the subject had answered all of the Items correctly. Crite- 
rion for the program was a correct response to each of the thirty Item^. 

Procedure 

Seventy-five subjects were assigned to fifteen strata on the basis of 
scholastic aptitude examination scores. Five Ss In each strata were randomly 
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assigned to one of five treatment groups: a) no feedback; b) knowledge of 
results feedback; c) knowledge of correct response feedback; d) response 
contingent feedback; e) a combination of b, c, d feedback. 

Independent Variables 

Analysis of variance performed on data obtained from the scores of S^s on 
The Pennsylvania State University Scholastic Aptitude Examination (obtained 
from University files prior to the study) showed no differences between treat- 
ment groups at the .05 level of significance. rAnalysIs was made of the correct 
response scores attained by ^s Immediately following the first Iteration of the 
30-Item program (the pretest). No significant differences were found among 
treatment groups. 

From this evidence. It may be concluded that there were no differences 
among the treatment groups with respect to scholastic aptitude, or to prior 
knowledge of the concepts. 

Rate of learning . In terms of the results obtained during the second 
Iteration and during the time spent by S^sr to reach criterion, there were strong 
Indications that Ss who received feedback guiding them to the correct response 
we*'e ’earning more effectively and performed better than did those who were 
forced to "discover" the correct response. The means of groups C, D, and E are 
significantly better at the .01 level of significance than those of groups A 
and B on the following criteria: 

Number of correct responses to second Iteration of program 

Number of responses required to attain criterion 

Number of Iterations of program required to attain criterion , 

Accumulated response latencies on second Iteration of program 

These results and their level of significance clearly Indicate some of the 
advantages to be gained by Instructing students with a feedback mode that guides 
them to the correct response. 

The results of these comparisons Indicate the value of providing Informa- 
tion to students during a programed Instruction sequence. The findings are 1n 
agreement with those of Holland (1965) who conduced, after analyzing several 
studies, that 1f a student does not know the correct answer, he might as well be 
told 1t. 
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However, Klaus (1965) In describing the point of view of those programers 
using the knowledge of results technique stated that they found no advantage 
In showing the correct answers to learners who provide Incorrect responses. 

Klaus states, "Simple substitutes, such as the statement, 'you are correct'' 
should prove equally effective as a confirmation of the correct answer." In 
other words, Klaus holds that the appearance of a correct answer serves as 
reinforcement only when the response Is correct; otherwise, the response 1s 
wasted. 

The poor results demonstrated by the knowledge of results feedback group 
(Group B) In the present study raise questions as to whether this mode of feed- 
back Is adequate for an adjunct auto-instructional program. Most of the studies 
Involving adjunct auto-instruction have utilized knowledge of results feedback 
and have only Informed the whether his response was correct or wrong. This 
type of feedback has been utilized 1n many types of teaching machines. Data 
from the present study, however. Indicate that providing a student with a state- 
ment of which response was correct, or providing him with a statement of why 
the correct response was correct would be of more value than merely telling 
him "correct" or "wrong." 

From the analysis of the means of all of the variables 1n this study. It 
1s Interesting to note that there was little difference between the means of 
the knowledge-of- results feedback group and the no feedback group. In none of 
the variables analyzed was there a significant difference at the .05 leyel 
between means of groups A and B. 

In the comparisons cited 1n the first part of this section as being Indica- 
tive of the advantage of using a feedback mode which guides the to the cor- 
rect response, there were no significant differences between groups C, D, and 
E. Apparently the factor which accelerated the learning of S^s was "being 
Informed as to which response was the correct one." In all of these compari- 
sons, however, the mean of Group E, the combination of feedback modes group, 
was only slightly, but not significantly better than the means of groups C and 
D, and In all cases, significantly better than the means of groups A and B. 

This finding Is contrary to those of Swets and his co-workers (1962) who found 
that "fairly extensive feedback may be, detrimental ." However, Swets et al_. used 
a small step programed Instructional sequence which resulted In few response 
errors . 
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"he findings of the present study are In agreement with those of the pre- 
viously cited study by Bryan and Rigney (1956). Although Bryan and Rigney 
found response contingent feedback to be superior to knowledge-of-resul ts feed- 
back, they made no comparison of these feedback modes with knowledge of correct 
response feedback. 

The results of the present study clearly demonstrate some of the Ineffi- 
ciencies of using a "discovery" approach In teaching facts or concepts by an 
auto-instruction program. Those Ss who were required to discover the correct 
response demonstrated poorer performance than did those S^s who were merely told 
the correct answer. 

< Time required for Instruction . The results from the time required to com- 

plete the first Interatlon showed clearly that those treatment groups which 
received long feedback messages (groups D and E) required significantly more 
time to complete the thirty Items In the first Iteration than did groups A, 

B, or C. The time to criterion means show that Group C required significantly 
less time than did groups D or E, and required the least time of the five treat- 
ment groups. 

The time required for a student to receive Instruction by CAI Is a function 
of the number of Instructional frames he completes and also Is a function of 
the amount of time the terminal spends displaying messages. Several studies 
have demonstrated that the operating speed of the IBM 1050 terminal Is slower 
than would be Ideal for an Interface between student and computer. The longer 
feedback messages require much more time because of the slow (120 words per 
minute) typing rate of the terminal. 'However, the new Interfaces using CRT 
display devices display verbal and graphic material much more rapidly than does 
the typewriter terminal. Therefore, the additional time required by ^s In 
groups D and E should be Interpreted with caution, since better equipment may 
soon eliminate those observed differences In Instructional time. 

The analysis of the data from the flost and second Iteration of the pro- 
gram and during the entire sequence Indicate that the principal difference 
between the treatment groups Is In rate of learning. Rate of learning may be 
considered In terms of the amount of Instruction that must be presented or In 
terms of the amount of time required to complete the Instruction. When rate of 
learning Is considered In terms of amount of Instruction presented, then a 




Feedback method which guides the student to the correct response Is clearly 
superior to a feedback method which requires the student to discover the cor- 
rect response. When learning rate is measured In terms of the amount of time 
required for Instruction, a feedback method utilizing short messages requires 
less Instructional time per frame than does one utilizing long feedback 
messages. However, this difference may be eliminated as better Interfaces 

between computer and student are designed. 

Retention . The analysis of variance on posttest scores Indicated that the 
combination of feedback modes group (Group E) was superior to other feedback 
and no feedback groups. Apparently the amount of Information the S derives 
from the feedback Is Important Id affecting retention. 

Because many of the programs used In previous studies have been of the 
linear low-error-rate variety, little work has been done to ascertain how to 
deal with errors committed by the student during a program. There have been 
few studies dealing with "corrective" feedback In verbal learning. One study 
found that providing the correct answer following an Incorrect response Is a 
reinforcing event In the same way that confirmation after a correct response Is 
a reinforcing event. The results of the present study Indicate the advantages 
for learning attained by providing the correct response when the S makes an 
error and also show the retention advantages of providing the S^wlth as much 
Information as possible In the feedback messages. These findings disagree with 
some studies that found that extensive feedback may be detrimental. 

Results obtained from the posttest also Indicate some differences favoring 
the response contingent feedback groups. On the posttest, the response con- 
tingent feedback group (Group D) received the second highest scores and scored 
higher than any other treatment group receiving a single feedback treatment. 

Group D accumulated significantly higher response latencies during the 
first Iteration 6f the program and during their performance criterion. Appar- 
ently the ^s receiving response contingent feedback were contemplating their 
previous feedback messages during the time period that they might have been 
responding. 

Relationship between analyzed variables and scholastic aptitude . Analysis 
of variance showed only one significant difference for level effects Instruc- 
tional time for the second Iteration of the program. There was no apparent 
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pattern In the means of strata for the admissible probability score on the 
first Iteration of the program, but examination of the time to criterion means 
for the 15 strata reveals a negative relation between scholastic aptitude 
and time for the second Iteration. 

A low correlation between Ss' rate of learning and academic ability Is one 
of the desirable characteristics of computer-assisted Instruction as expressed 
by Mitzel. Mitzel hypoth^lzes that computer-assisted Instruction 

. . .at Its best should offer ^ distinctly Individualized 
course of Instruction In which gaps In the learner's know- 
ledge are filled by means of diagnostic and remedial 
sequence steps. Thus, It^seems to be theoretically appro- 
priate to ask the typical CAI learner to achieve mastery 
of the content as long as we allow him a reasonable amount 
of time. (Mitzel , 1966) 

Mitzel concluded that If examining Is done at appropriate Intervals 
throughout the program, then every learner should have achieved mastery of the 
content up to the limits of his capacity. 

Further researches necessary to determine the effects of using various 
modes of feedback to correct errors. Many forms of programed Instruction 
require the student to reveal, by making some sort of error,, the kind of 
Instruction he should receive next. However, most typical programed Instruc- 
tion studies have been conducted with relatively error- free programs and little 
Is presently known about correcting student errors In programed Instruction. 

The present study should be repeated using a student terminal capable of 
faster communication and response time than the 1050 terminal. 

Also, the present study should be repeated using a delayed retention 
measure In addition fb the Immediate retention measure. 

The high posttest scores achieved by all groups. Including the control 
group, demonstrated the value of reiterating the program Items until the stu- 
dent had answered all Items correctly. Several studies have demonstrated the 
value of providing feedback on test Items. The results of the present study 
Indicate that an additional advantage can result from having an repeat all 
unanswered questions until he has correctly responded to each one. This pro- 
cedure provides a "drill" type of exercise In a test situation In addition to 
providing feedback. 
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Effect of CAI Natural Spelling Behaviors 

Rationale 

Although a field trial had Indicated that the CAI spelling course was an 
effective means for two-year technical students to learn spelling, no attempt 
had been made to examine whether the students transferred their Increased know- 
ledge of spelling rules (as Indicated by criterion scores) to off-terminal, 
non-test writing situations. Consequently, the Investigation of transfer was 
selected as the primary focus of the present study (Farr and Hogan, 1967). 

It was assumed that after the diagnosis and Identification of spelling 
errors, followed by remedial Instruction, students would spell more accurately 

t 

than they 'had In non-test, writing situations before Instruction. Further, It 
was assumed that students who were merely Informed of the number and kinds of 
spelling errors that they had made on the pretest would show less Improvement 
In non-test, writing situations than the students who had been given the same 
'Information arid also received prescribed remedial Instruction. Accordingly, 
the main dimension Investigated In this study was the difference In ^he extent 
to which the Instructed students transferred their demonstrated spelling skills 
In contrast to those who had not been Instructed. 



Method 



The materials used In this study were of three types: a) two samples of 

expository writing done by the students on topics they selected from a list 
provided; b) selected segments of the CAI spelling program; and c) a 44-Item 
attitude questlonnfaire about CAI. 

The toplc^for these writing samples were deliberately planned by the 
authors to center the attention of the students on the thought content of their 
writing, rather than on spelling or other mechanics of composition. Further- 
more, no mention of spelling was made when the writing assignments were given, 
and the^ attitude questionnaire was concerned with CAI and the students' reac- 
tions to It, rather than to any aspect of spelling. 

From the CAI spelling program, all of the students were given three 
segments on-line: orientation, word study, and the diagnostic test. T)ie first 

segment was a short one dealing with orientation to £he terminal equipment and 
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Its operation. The second segment p^vided the students with further oppor- 
tunity to familiarize themselves with appropriate on-line procedures, as well 
as iSreparatlon for maximum benefit from spelling study. The diagnostic segment 
^consisted of a 37-word test which Included 50 possible error Items representing 
nine categories of spelling errors. For example, the word "piece" was desig- 
nated as botlf a possible homonym error and as a possible "1-e" error. 

In addition to tthese three segments, the students In the experimental 
group took the on-line Instruction prescribed by their diagnostic test per- 
formances, and a 37-word 250-Item, on-linv'? posttest similar to the diagnostic 
test. 

The 48 students participating In this study were enrolled In post-high 
school, two-year technical programs. The experimental group consisted of 23 
students; the control group contained 25 students. Two of the experimental 
students were women; one of the control students was a woman. 

Resul ts 

The effectiveness of transfer from this CAI spelling program was assessed 
on two dependent measures: a) performance . on the spelling pretest and posttest 

(minimal transfer); and b) performance on two writing assignments (remote 
transfer). 

Spelling te^st data for the experimental students were analyzed within a 
2x2 factorial design (two student groups x two test scores and/or pretest 
and posttest scores) with repeated measures on one factor (pretest and 
posttest). The results of this analysis Indicated that there was a significant 
Improvement In spelling test performance on the CAI posttest (p <.05). How- 
ever, when absolute criterion performance was examined. It was found that the 
experimental students had entered the program performing at a 66% level of 
accuracy, and their end-of-program criterion performance was only'76%. These 
results Indicate that some learning had occurred, but that the students' diffi- 
culties with ^sj^el ling had by no means been entirely eliminated. 

Conclusions 

r . ' 

The main conclusions from this study to investigate the effectiveness of 
transfer from this CAI spelling course were: a) students In ^o-year 
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technical courses demonstrated a significant improvement In their spelling 
abilities as measured by spelling tests, after they had received Instruction 
from this CAI program; and b) when they were not specifically told, on writing 
assignments, that "spelling counts," post-high school technical students made 
far more errors In certain categories than they made In those categories 
during test situations. 

Because, for the non-test writing samples gathered In this study, students 
were free to use — or not to use — any words they wished. It Is reasonable to 
conclude that the ones they used are the words they "need" to know how to 
spell; the very words that formal spelling Instruction alms to teach. Like- 
wise', the large number of errors appearing in the writing samples can be taken 
as an Indication of the failure of traditional, classroom spelling Instruction 
to achieve Its commonly stated goal of teaching "needed" words. 

The' novelty of CAI experience and the appeal of Its technology for students 
In technical courses did not produce a markedly greater amount of transfer of 
‘ spelling ability to non-test. situations than had other methods of Instruction 
earlier In the students' educational experiences. This, however, should not be 
regarded as failure of this CAI course. Unanimously, on the attitude question- 
naire students Indicated that they felt that spelling was a subject that could 
be effectively taught by CAI, and their scores Indicate that It was. Since, 

Ci|\I does not seem to affect their spelling In general writing situations any 
more than any other method of Instruction, It might be of particular value to 
consider the ways In which students — and teachers — approach spelling Instruction. 
Such consideration Is recommended if the present CAI course Is revised In the 
future. 

Perhaps, If adults who are In need of remedial spelling* -are to be "all- 
around" competent spellers, the spelling course must Include an attempt at 
attitude change, so that spelling is accepted as a skill with "all-around" 
Importancjs, Otherwise, for many students, and especially for students In tech- 
nical courses, spelling Is likely to remain a subject In which students do as 
well as possible only on spelling tests and In situations where they know that 
"spelling ciaints. " 
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Comparability of Computer-Assisted and 
conventlonaT^est AdmInIstratTon 

I 

u , 

Purpose 

The purpose of the research reported here was to compare conventional 
group administration and computer-assisted administration of a test of crea- 
tivity (King and Rablnowtiz, 1968). 

I 

Method 

Two separate itudles were conducted using different Ss and slightly differ- 
ent procedures. They used the same basic measures and analysis* however* and 
thus may be presented together. Study I was a preliminary effort to the larger, 
more extensive Study II. 

Subjects 

Study I used 37 paid volunteer male tech'KIcal education (two-year program) 
students enrolled at The Pennsylvania State Unm^^slty. Random assignment was 
made to either a computer-assisted or a convent1ona1\^^t administration con- 
dition. Study II used 107 (36 men, 71 women) volunteer undergraduates enrolled 
in baccalaureate programs at The Pennsylvania State University. Ss within each 
sex were randomly/ assigned to the two test conditions to Insure equal propor- 
tions of men and women under each condition. . 

Analysis 

The problem of determining whether computer-assisted testing and conven- 
tional testing are directly comparable is really a problem of determining the 
equivalence of two forms of the same test— one administered by computer and the 
other by^conventional procedures. 

Medley (1957) has proposed a procedure for testing the equivalence of two 
tests which examines four criteria: equality of means, equality of variances, 

equality of errors of measurement, and "homogeneity of function." The pro- 
cedure Is based upon a two-factor analysis of variance with repeated measures 
on one factor, and is especially appropriate for use in studies of the type 
reported here where carry-over effects necessitate the use of different sub- 
jects for the two test forms (or in this case two modes of administration). 



In the present experiment, the Medley test for equivalence was applied 
In both Study I and Study II to compare the performance of the computer- 
assisted and convent1on|l groups of the Remote Associates Test (RAT) Form I. 
The two administration modes coupled^wlth the 30 Items of the RAT resulted In 
a 2 X 30 factorial design, with repeated measures across subject. In the 
Medley procedure each of the four jrlterla for equivalence (equal means, equal 
variances, equal errors of measurement, and homogeneity of function) can ^e 
stated as a null hypothesis, and If any are rejected the tests In question 
cannot be regarded as equivalent. If all four null hypothesis cannot be 
rejected then the overall hypothesis of equivalence may be accepted. The four 
F-ratlos corresportding to the four hypothesis were calculated and tested for 
significance In both studies. 

Additional correlational analyses were performed In Study II to determine 
the existence of possible dlf^rentlal relationships between the two adminis- 
tration modes of. the RAT For^M and the four reference measures. Pearson 
Product-moment Correlation Coefficients were calculated between each of the 
reference measures and each, mode of administration of the RAT Form 1, and all 
pairs within administrations were tested for significant differences with z- 
transformatjons. . . 

Resul ts 

The means and standard deviations for all administrations compared favor- 
ably with .those reported by Mednick and Mednick (1967) In the normative data 
for college undergraduates. Hoyt Internal consistency reliability estimates, 
calculated from- the analysis of variance format used for the Medley procedure, 
were found to be slightly lower than odd-even split-half coefficients reported 
by Mednick and Mednick. 

One noteworthy comparison that can be made Is the high degree of similar- 
ity between the performance of the technlwl education ^s In Study I and the 
baccalaureate program Ss In Study II. Students enrolled In two-year technical 
education programs are generally believed to be less Intellectually capable 
than four-year students. Although many variables were uncontrolled between 
Studies I and II the results would appear to Indicate that In at least one 
dimension of Intellectual functioning the two-year students compare quite 
closely with four-year students. 



Medley Equivalence Analysis 
Analysis of Variance: RAT Form 1 







Study I 






Study II j 




Source 


df 


MS 


F 


df 


MS 


F • 


Conventional Administration 














Subjects 


17 


1 .00 


1.37® 


, 53 


.88 


.81® 


I terns 


29 


.80 


k 


29 


1.99 


1.06^^** 


Error 


493 


.19 


1.00° 


1537 


.19 


CAI Administration 














Subjects 


• , 18 > 


.73 


• 


52 


1.08 




Items 


♦ 29 


1 . 04: 




29 ■ 


2.57 




Error 


522 


.19/ 


1508 


.18 




Combined Groups 














Subjects 


36 ■ 


.85 




106 


.99 




I terns 


29 


1.63 




29 


4.18 




Error 


1044 . 


.19 




’ 3074 


.19 










- 






Analysis for Testing 














Equivalence 




1 


t 








Administrations 


1 


.26 


.29° 


1 


1.32 


r.34° 


Subjects (within 














administrations) 


35 


.87 




105 ■ ■ 


.98 




Items 


29 


1.63 




29 ' 


4.18 


2.11^** 


Error Between 


29 ' . 


.21 


1.10° 


29 


.38 


Error Within 


1015 


.19 




• 3045 


.18 





“F ratio formed by comparing MS for^^bjects under conventional administration with MS. for subjects under 
CAI administration. Actually a test for'/homogeniety of variance. 

^F ratio formed by comparing MS for error under conventional auinini strati on with MS for error under CAI 
administration. Actually a test for homogem ety of the variance pf errors of measurement. 

^ ratio formed using • subjects within administrations as a conventional error term. A test’ for equality 
of means for the two administration conditions. 

ratio formed using error -/i thin adrir.istraftiurs as a conventional error ter"’, a test for hnnnooniety 
of function which compares the rank order of item difficulties for the two administration conditions. 

** 2 . <*01 ' . * 






/ 



O 

ERIC 






84 



77 



The Medley equivalence analysis and the calculation of the F-ratlos used 
to test each of the four equivalence criteria necessitated dividing the overall 
analysis of variance Into separate analyses representing each mode of adminis- 
tration, and an analysis representing the combined administrations. The first 
criterion of Interest, equality of means for the two administration modes, was 
tested by comparing the variance between administrations with the- variance for, 
S^s with In, administrations. The resulting F-ratios for both studies were non- 
significant, Indicating failure to detect differences with respect to the mean 
performances under the two modes of^ administration. The second criterion, 
equality of variances, was tested by forming an F-ratio from the mean square 
for subjects In ear.h of the separate mode analyses. Again, the F-rat1os for 
both studies were nonsignificant, and the conclusion Is that the variances for 
the two modes of administration are not reliably different. The third crite- 
rion, equality of measurement error variances, was tested by an F-ratIo formed 

X ■ • 

from the error tenns In each of the separate mode analyses. Here a significant 
F was obtained for Study II, but since the value of the F was only 1.06, with 
1537 and 1508 ^ the difference Is probably not of great consequence. Thus, 
the criterlons of equal error of measurement variances also appears to be 
reasonably satisfied. The final criterion, homogeneity of function, was tested 
with an F-ratio formed by comparing the error between administrations with the 
error within administrations. A significant F was obtained for Study II indi- 
cating that the Item difficulty rankings were hot the same for both modes of 
administration. Items proving very difficult under computer administration 
were apparently slightly easier Under conventional administration and vice y 
versa. The resulting conclusion Is that In Study- II the RAT Form 1 was not 
measuring Identical functions ^nder the two mod.es, of administration. 

Additional correlational analyses performed In Study II resulted in cor- 
relations between each of the administrations of the ^ RAT Form-1 and each of the 
reference measures correspond (In the case bf the first three reference mea- 
sures) roughly with those reported by Mednick and Mednick. The correlations 

between the RAT Form 1 and the RAT Form 2/. are slightly lower than reported In 

> • 

the Test Manual. The fourth reference measure. Flexibility, does not appear 
to correlate with the RAT. All four correlation pairs between administration 
TOdeS were tested for significance, and none of the differences proved 
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significant. Thus, there Is no evidence to Indicate that the parallel forms 
reliability or the validity of the RAT are any different under computer admin- 
istration than under conventional administration. 

In summary, the study reported here does not present any evidence to In- 
dicate that computer-assisted test administration Introduces new stjurces of 
variance that markedly modify the statistical properties of a test as deter- 
mined through conventional admini strati pii. 



Numerical and Verbal Aptitude Tests 
Administered at the CAI Student Station 

Purpose 

The purpose of this study (French and Tardibuono, 1968) was to arrange 
tests using multiple choice, numerical, and verbal Items, In a program so that: 

1) the average number of Items attempted by each student will be 
significantly less than the number of Items traditionally required by 
a test of similar content (In this case, the Henmon-Nelson Test of 
Mental Abl 1 1 ty) ; 

2) the test will take significantly less time to administer 
than the traditional test; 

3) Indices of reliability obtained by means of Internal con- 

sistency formulas (KR 20) will be higher for COMPAT (Computer Admin- 
istered Test) than for those reported In the manual for the Henmon- >> 
Nelson tests; and ‘ 

4) there will be a significantly high correlation between each 
COMPAT and the Henmon-Nelson Test , and between each COMPAT and stu- 
dent performance In other academic activities. 

The Sample 

A 

One of the practical limitations encountered In the first phase of this 
project was the availability of subjects of the appropriate age and educational 
level willing to take time for research projects. Since this project focuses 
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on the feasibility of developing short, highly reliable tests, vocational- 
technical school subjects were not sought. The 73 subjects used In this 
reporting period included high school juniors and seniors, housewives, and 
undergraduate and graduate students from Penn State. It should be noted that 
80 subjects took the various tests. However, systems difficulties and loss of 
subjects reduced the number to 67. 

Procedure 

Each subject took five tests: 1) the Henmon-Nelson College Level , Form B 

2) Verbal 80, 3) Numerical 80, 4) Pretest, and 5) Verbal A, B, C, or D. The 
directions for the Henmon-Nelson are contained in the test booklet which each 
subject read himself. For the COMPAT tests, each S was shown how to operate 
the terminal, how to respond, and how to correct a mistake. He was Instructed 
as follows: 



You will be shown questions, either verbal or mathematical 
on the screen at your left. As soon as you have the answer, 
type the number Indicating that answer^, then press EOB; the 
next question will then be. shown. If you wish to change an ' 
answer before you press EOB, follow the procedure previously 
described. Remember once' you press EOB you will not be able 
to change your response. There Is a time limit for each 
question; but If you work steadily, you need npt rush. I 
will be In the next room If any complications arise. Any 
questions? You are how ready to begin. 



subjects returned for a. second session. The availability of computer time as 
well as consideration for the subject's schedule made exact Intervals between 
sessions Impractlc;^! . Each subject was.^ paid a flat rate of $3, unless system 
failures necessitated returning for a third session In which case payment was 
made at the rate of $1.25 per hour. 

As each S entered the terminal room, he was given either the Henmon- 
Nelson College Level , Form B, the pretest, or assigned to one of the computer- 
administered tests. • Due to the varying lengths of time subjects spent on each 
of the tests, it was not practlcal to randomize the order of the tests. 



Due to the length of time necessary to complete 




Resu1 ts 



To achieve goals 1 and 2 required the administration of relatively few 
Items In a relatively short period of time when compared with the administration 
of the conventional format of the Henmon-Nel son . In conventional format the 
Henmon-NelSon test provides 100 Items and allows no more than 40 minutes of 
working time. While not all subjects attempt the 100 Items, It Is assumed that 
as subjects run Into difficult Items they scan the remaining Items In hopes 
that they can find some which they can answer. With the COMPAT procedures, the 
mean number of Sterns attempted Varied from 23 to 30 and the mean number of 
minutes varied from 21 to 31. Relatively large standard deviations were 
observed for both number of Items attempted and time spent on the test. The 
objectives of constructing a test with fewer administered Items than on the 
criterion test was realized. When the numerical test and verbal test were 
added together, a mean of 57 Items was obtained. 

Time was obtained by subtracting "sign-on" time from "sign-off" time. 

The figures Include minor system delays and program malfunctions. By analysis 
of the response latencies of a random sample of 25 subjects. It was learned 
that the time to complete the test Is decreased significantly when only 
response latencies to each Item are considered. 

Goal 3 pertains to reliability. At this stage of development with these 
tests, test- retest procedures over short periods of time did not seem appro- 
priate. Statistical formulas requiring that the same Items be presented to 
each subject were Inappropriate also since the same pattern of items was 
presented to few subjects. Since, great care was exercised In the selection of 
items arranged In order of difficulty, 1t was assumed that all Items which were 
not administered and which wdre below the score would have been passed. It was 
further assumed that all Items which were not administered and which were above 
the subject's score would have been failed. Since these assumptions are 
Implicit In the computation of the score, 1t'1s reasonable to assume them also 
in the computation of reliability coefficients. (Such procedure Is followed In 
the administration of such tests as the Stanford-Blnet .) 

It should be noted that Kuder-RIchardson formulas yielij slightly higher 
correlations than other methods of measuring reliability and that the, technique 
of assigning a minus or a plus to unanswered Items will tend to Inflate the 
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obtained correlations. The Kuder-RIchardson coefficients ranging frorti .977 to 
.988 compare favorably with the odd-even reliability coefficients of .94 and 
.95 reported In the technical manual for total scores of the college level 
Henmon-Nelson tests. The technical manual reports alternate form reliability 
coefficients of .84, .876, and .887 for Q, V, and total scores. Thus, It is 
concluded from the first phase of the reliability study that a highly reliable 
test can be adapted for presentation by a computer. 

The final area of Investigation to be reported here Involves a comparison 
between COMPAT and the conventional Henmon-Nelson test. The relationship 
between COMPAT and the conventionally administered Henmon-Nelson test are not 
as substantial as those reported In the Examiner *s Manual for alternate forms 
of the Henmon-Nelson . 

It was evident from the data that the normative data for the Henmon-Nelson 
cannot be used to Interpret COMPAT scores. Norms will need to be developed If 
COMPAT scores for Individuals are to be Interpreted. 

It should be noted that the number of subjects who took COMPAT Verbal -C 
or Verbal -D was dependent on their score on the pretest. Since COMPAT Verbal-A 
and Verbal -B were administered to only 10 subjects, correlational data for those 
tests were not computed. 



Remedial and Review Branching 1n_ 

. Computer^ssisted Instruction 

j Purpose 

There are two basic kinds of branching strategy. The first Is to branch 

I the student to an alternate sequence of remedial material. The second Is to 

' provide the student with a review or re-exposure to material he does not yet 

I understand. 

I The purpose of this Investigation (Gilman and Gargula, 1967) was to com- 

pare the effectiveness of branching strategies In an Instructional program 
I prepared for computer-assisted Instruction with that of a nonbranching CAI pro- 

gram. 

1 
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Method 



The subjects were 42 students from the tile setting and plumbing programs 
of Williamsport Area Community College, Williamsport, Pennsylvania. These stu- 
dents were selected because they had not previously received instruction in 
physics. All were naive with respect to educational experimentation procedures. 

Subjects were randomly assigned to two proportional groups. The linear 
group consisted of 14 Ss and the branching group consisted of 28 ^s. The ran- 
domization was accomplished by the use of a wel 1 -shuffled stack of student data 
cards. S^s were pretested with the 10-item pretest. No answered more than 
four questions correctly, and most answered all questions incorrectly. 

The linear group received only the Instructional frames of the program. 

The branching group received the instructional frames and corresponding remedial 
frame when an Incorrect response was emitted during the Instructional frame, 
but also reviewed segments of the program on which they had a high error rate. 

Response latency, or the time required for the student to answer a ques- 
tion, was recorded by the computer for each response and was accumulated during 
the instructional period. The total instructional time was also recorded by 
the computer. 

Immediately following the instruction, the 25-item posttest was adminis- 
tered to each subject. 

All Instruction was "stand alone" Instruction In that no other instruction 
was provided other than the programed course. 

There were slight differences In the means of the posttest favoring the 
branching group and ai slight difference In instructional time favoring the 
linear group. These small differences were not statistically significant 
(P >.10), but they do suggest the need for further study of this variable In CAI 
mode. 

One Important factor In comparing the programs was the number of responses 
required in the program. The difference In the means of the group were signi- 
ficant (P <.001 ). Clearly, more responses were required by the branching group 
than by the linear group. 

It Is Interesting to note that although the branching group required more 
responses to complete the program, the mean response latency was less than thait 
of the linear group, so that differences between the means of the total 



accumulated latencies for the" two groups were not significant (P <.10). The 
lower latencies perhaps resulted 'from a greater amount of practice In using 
the terminal Interface. 

Discussion 

The major conclusions of the study may be summarized as follows: ^ 

1) No differences In achievement' were obtained for a CAI program which 
Incorporated Instructional frames, branching to remedial frames, and review 
of program segments over a program which presented only Instructional frames. 

• 2) As. a result of a criterion established by the programer, the students 

In the branching group required significantly more responses to complete the 

program. However, this learning strategy resulted In no noticeable gains In 

\ • 

learning. 

3) Although the branching group required significantly more responses 
to complete the program, the mean response latencies of the linear group were 
lower than those of the branching group. Thus, there were no differences In 

the total accumulated response latencies for the two groups. 

✓ 

Conclusion 

The results of the present study appear to be consistent with the results 
of Holland (1965), Campbell (1961, 1962), and Glaser (1962) In that no advan- • 
tages were found for a branching strategy. 

The results are not consistent with those found by Skinner (1961) and 
Holland and Porter (1961). Evans (1965) and Barlow (1963) who have found the 
controversy of '^linear vs. branching” to be one which cannot be answered 
unequivocably, since the two Instructional techniques serve different functions. 

The results of this study Indicate that If branching Is to be used to 
advantage In computer-assisted Instruction, there must be a thorough Investi- 
gation of those situations where It facilitates learning. Also, research needs 
to be Implemented to detennine the criteria for branching decisions. 



Relative Effectiveness of Various Modes of , 

, Stimulus Presentation tfirtiu^ 

Computer-Assisted Instruction 

t ' _ 

Purpose 

The purpose of this study (Johnson and Borman, 1967) was to determine the 
relative effectiveness of the various modes of presentation on total time for 
s^dents to complete the course and on competence as determined by a posttest, 
score. 

Based on selected studies, It was hypothesized' that the static display 
mode of presentation would take significantly less time and result In as 
equally effective learning as the typewriter-output mode of presentation since 
the static display mode presents a paragraph of material to a student at a time 
and allows him to proceed at his own pace. The material chosen for this study 

* i V 

was a basic physics sequence or "Working with Unlts^" The instruction was 
designed for vocational -technical students, who have f1n1shed:high school and 
have ar 11ml ted. background In mathematics and. physics. 

■■■’ ■ - ;■■■ . i. 

Subjects f ' 

The S^s consisted of 90 upperclassmen , majoring In education and taking 
, Instructional Media 435 -at -The Pennsylvania State University during the Fall. 
Term, 1966. Each S in the Instm., 435 class was required tp spend one' hour at 
the 6AI student staiti on.' The Ss were Ya'ndomly assigned to one of four groups. 
(Due to computer malfunction and scheduling problems, the final ^Toups did not 
contain equal numbers.) None of the S^ possessed a background of study In 

mathematics or physics prior to the treatment. 

* ' * ■ « ♦ 

S ' ‘ ^ 

Procedure . • ’ \ 

' Type Mode . The S^ signed on the course, the computer typed out Instruc- 
tions followed by questions. After the typed his answer, the computer pro- 
ceeded by typing material to the S, showing slides, typing questions, etc., 
until the lesson was completed. The S_ was immediately tested on his knowledge 
by a 15-Item, multiple choice, computer-admiillstered test. Total Instructional 
time and test scores were recorded. 



Audio Mode , who received Instruction through the audio mode heard the 
same material that the S^s in the previous mode read from the typeout. Ss could 
repeat each message as often as ciesired; They also received some typed mate- 
rial and slides which were common to all groups » When finished, they took the 
same computer-administered test. Total Instructional time and test scores were 
recorded. 

Display Mode . S^s in the display mode had a booklet containing all of the 
messages heard by the above group. Insteadvof hearing the messages as the 
above group, the typeout instructed them to read the proper page of the book- 
let. This group also received the same typed material and slides as the above 
groups. The same computer-administered test was taken by this group and their 
total instructional time and test scores were recorded. 

Control Group . . ^s in the control group received no instruction, but took 
the same computer-administered test as the above groups. Only their total test 
scores were recorded. ) 

Findings 

An analysis of variance procedure gave the results shown in Table 5. The 
F-ratio was significant beyond the .OB level of confidence. Sheffe's procedure 
for multifile comparisons (Sparks, 1963) showed that the audio, type, and display 
modes of presentation were all signfficantly superior to the control group con- 

* t 

cerning posttest scores. There were no significant. differences between the 
audio i type, and display modes. 

The above finding suggested to the authors that there niay have been too 
much overlap between the type mode and the other modes since 39 out of 55 frames 

were common to all groups in stimulus mode. This commonality rnay have hidden 

\ 

any mean differences in completion time. In order to remedy this situation, 
the authors decided to run the experiment again, this time increasing the 
number of frames containing variable modes of presentation. 

Subjects N 

The.Ss consisted of 87 ^upperclassmen majorih^ in education and taking 
InstV-uctional Media 435 at The Pennsylvania State University during the Winter 







Means and Standard Deviations of Posttest Scores 
(Maximum Possible Score 15 Points) 
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Term, 1967. Each S_ In the Instm. 435 class was required to spend one hour at 
the CAI student station. The ^s were randomly assigned to one of four groups. 
The S^s did not have a mathematics or physics background. 



Implications 

The purpose of this experiment was to examine the question of decreasing 
Instructional time on-line through various modes of presentations without a 
decrease In learning. 

Special note should be taken of the findings Indicating that the mean 
scores on the posttest for each experimental group was significantly higher 
than the mean score on the posttest for the no-lnstructlon control group. It 
should also be noted that there were no significant differences on posttest 
score among the experimental treatments (audio, display, type, and slide). 

This was a consistent finding Irj both experiments. Therefore, regardless of 
mode of presentation, all groups were able to learn from the programed sequence 

The main purpose of the experiment, to decrease instructional time on-line 
did not result In significant findings. However, there are some Interesting 
tendencies which warrant further investigation. 
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An Experimental Procedure for Course Revision 
Based oiT Ttudents' Past Performance 

Purpose 

In an earl ler study the researchers had Investigated the time required to 
complete a program under various modes of stimulus presentation. No significant 
differences were demonstrated between the various modes because of the large 
variances obtained In the dependent variables for the various modes. At that 
time It was the Intent of the authors to analyze each subject's performance on 
each frame In order to determine whet;^her or hot there were certain frames In 
the program that contributed a large proportion of variance to the total within 
groups . variance. This study (Borman an^ Johnson* 1968) was an attempt to 
Improve the program. 

Method 

Upon completion of revisions, the course originally titled, "Working tilth 
Units," contained 47 frames including six slides common to all modes of presenta- 
tion. The sequence was designed so that all Ss received four warm-up frames, 
each frame presented In a different mode, the main purpose of which was to 
acquaint each £w1th the correct method of terminal operation. Following the 
Introductory material, 43 frames of material were presented for which data 
were collected and analyze,d. 

In order to provide for a variation In stimulus modes, , four versions of 
the course were created. The material from the 37 frames (not Including slide 
material) was presented four ways. One group received material on audio 
tape to provide the audio mode of presentation. One group received this 
material printed on charts and put together In a booklet, each page of which 
contained the material from one frame of the program. The program Instructed 
the Ss to. read a given page. This mode of presentation provided the chart 
display mode of presentation. In a third version of the course, the typo mode, 
the material was typed to the student on tlie typewriter associated with the IBM 
1050 computer terminal. The fourth group received the Instructional material ^ 
on 2 X 2-1nch photographic slides; the material, was Identical to that contained 
on the audio tape, chart display group, and typewriter output. All groups 
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received Identical versions .of the course and all groups were required to 
answer the questions by typing their answers on the typewriter keyboard at the 
terminal. 

A 20-Item constructed-response test was created. The test was designed to 
measure factua) material as presented In the program as well as a subject's 
ability to transfer what he learned to similar problems. For example. In 
addition to dividing meters by seconds, a concept taught In the course, the ^s 
also had to divide ficticious units such as dividing "yens by fuds." Since' -the 
program was not designed to teach computational skill. It was decided to 
score the test only on the basis of whether or not the S had the correct units, 
not whether or not the S had- the right numerical answer. The Kuder-RIchardson 
Formula 20 reliability of this test was .862. 

Subjects 

The consisted of 33 volunteer upperclassmen jnajorlng In education and 
taking Instructional Media 435 at The Pennsylvania State University during the 
FaVl Term, 1967. The ^s were randomly assigned to one of the four experimental 
treatments. The S^s did not have a mathematics or physics background. In ad- 
dition another group consisting of 90 upperclassmen majoring In education and 
taking Instructional Media, 435 at The -Pennsylvania State University during the 
Fall Term, 1967, served as a naive control group and took only the posttest. 

Procedures , ^ 

Each S^ signed on the course and was presented with the Instructional 
material and questions based on the material. The S^ responded to the questions 
by typing his answer on the typewriter keyboard. Feedback material was pre- 
sented by the computer to all ^s via the typewriter. Upon completion of the 
cou'rse, ^s were administered a 20-^questlbn constructed-response test off-line, 
total for each question, the response latency for each response, and the 
number of correct responses on the posttest were collected for each subject. 

Results 

The main purpose of this experiment was to^ test a procedure for course 
revision based on past performance." Graphs were prepared to Indicate weak 
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sections or frames In the course based on high mean response latencies and/or 
high mean numbers of attempts. The graphs also Indicated frame-by-mode-of-pre- 
sentatlon Interactions, I.e., Indicated frames where oh? mode of presentatipn 
was superior or Inferior to the other modes of presentation. It Is felt that 

y 

by examining these Interactions, It may be possible to Indicate which mode of 
presentation should be used for which purposes as well as how to best use a 
medium for a specific purpose. For example. It was found that, for the giveh 
course mateHal, It was necessary to keep the audio messages relatively short. 

I4J revising the course, care was taken to Improve those frames which con- 
tributed large proportions of variance to large mean response latencies and the 
high mean numbers of attempts. The revisions would tend to make the course 

f 

more uniform and easier for all groups, since all versions of the course were. 
Improved, a condition reflected by the minute mean differences for total time 
to complete the program. A possibility for future research would be to revise 
only the frame for the modality which experienced difficulty, leaving the other 
frames unchanged. Diagnostic revisions may serve to lower within group vari- 
ance and capitalize on the differences that are Inherent In the various modes 
of stimulus presentation available with CAI , 

The course material used In this experiment Is the product of a number of 
revisions softer It had been carefully written by a subject matter and program- 
ing expert. Even now. It Is far from being optimally efficient and effective 
i stimulus material to promote student learning. There are still many peaks and 

valleys that must be accounted and compensated for through revisions or branches. 
The most significant finding to date Is that course development Is a complex, 

' time-consuming process which must be carried out In a context where student per- 

, formance data are continually used as a basis for subsequent revisions. 



Expressed Student Atl^lfrdes Under Several Conditions of 
, Automated Programed Instruction 



Purpose 

Due to the rather general finding that student attitude and performance 
measures tend to be only moderately correlated. It cannot be assumed that a 
program which results In satisfactory criterion performance will necessarily 
result In a positive student attitude. If It Is granted that student attitude 
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may have significant effect? on students' behavior after the period of Instruc- 
tion, It seems that a different approach to the study of student attitude 1s 
called for. Rather than studying, the effect of student attitude on criterion 
performance, research should be directed to developing Instructional programs 
which achieve both satisfactory criterion performance and positive student 
attitude. In this experiment (Brown and Gilman, 1967) student attitude was 
treated as one of the outcomes gf Instruction. 

f ‘ 

Method . ; . 

The subjects were 66 ninth and tenth grade students In the college prepara- 
tory curriculum of State Collie Junior High School. All were naive with 
respect to educational experimentation procedures, and nope had received Instruc 
tion In physics. All S^s who began the experiment completed It. 

. Three programed courses were prepared. The subject of the three programs 
was dimensional analysis, or performing calculations Involving units of measure- 
ment in working physics problems. The material of all three programs was 
Identical with the following exceptions. The first program (CPF) was a CAI pro- 
gram utilizing £ontingent £rompt1ng and feedback. The second (KCR) was also a 
CAI program, but feedback consisted of the knowledge of the £orrect response. 

The computer typed the' correct response two Inches to the right of the student's 
response as In a typical programed text. The third group (text) received 
Instruction which contained feedback material Identical to the KCR program, but 
was presented by a programed text rather than by a computer controlled terminal. 

Design 

Subjects were randomly assigned to three groups. The randomization was 
accomplished by the use of a shuffled stack of student d^ata cards. Ss were 
pretested with the ten-question pretest. No S answered more than three 
questions on the pretest correctly and most answered all questions Incorrectly. 

In all three groups the Instruction was completed In a single session. 

All Instruction was "stand alone" Instnjctlon In that no other Instruction was 
provided other than the programed course. There were no difficulties with any 
of the equipment used during the experiment and the CAI groups experienced no 
down time or delays on the hardware. 



student attitude was measured by a 40-item Like^t-type scale, previously 
developed at The Pennsylvania State University CAI Laboiratory. 

Student responses were scored 1 to 5, with 5 being the response which 
indicated the most favorabile attitude toward the instruction. The maximum 
attainable score was 200. Kuder-Richardson formula-20 reliability obtained 
during an earlier study was .885. 

The attitude scale was administered to each S^ following the session of 
Instruction. 



Results 

The responses of each student to the 40 items on the attitude scale were 
summed to yield one score for each student. The data were analyzed within a 
two-factor, treatments by sex, analysis of variance design. The only signifi- 
cant difference found was between .the three -treatment means (F = 12.89, df = 62, 
P <.001 ).. Scheffe's "S-test" was performed on the three group means. This 
analysis showed that both KCR and CPF means were significantly different 
(P <.01 ) from the text group. The KCR and CPF were not significantly different 
from each other (P >.05). 

Groups KCR and CPF scored significantly higher on the attitude inventory 
than did the text group. There were no significant differences between the KCR 
group and the CPF group. There were no differences attributable to sex. 

The differences between groups receiving computer-assistjed instruction and 
instruction by programed text are similar to the anticipated results. The 
differences in attitude scores cannot be attributed to differences in perform- 
ance' as the three groups did not differ significantly on either posttest or 
retention test performance. The groups did differ on the amount of instruc- 
tional time required; however, in this experiment there seems to" be no basis 
for explaining attitude in terms of time per se. Apparently the more positive 
expressed a'^t;1tude computer-assisted instruction as compared to the attitude 
Expressed toward programed texts is attributable to student preference for a 
novel automated Instructional medium. 

% 

In the opinion of the authors the approach to the study of student atti- 
tude suggested in this report and illustrated by the above experiment should be 
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employed, In conjunction with, If not Instead of, the typical correlational 

• ^ i 

j ' apjsroach, in research aimed at the development of Instructional programs which 

* " achieve both satisfactory criterion perfortnance and positive student attitude. 

r: . 

Effects of Reducing Verbal Content In 
I Compute r^ss 1 s ted instruction Programs 

Purpose 

[ This stu^lrwestl gated the effects resulting from reducing the verbal con- 

tent In a CAi pro^am. The rationale for this treatment ‘Is that those students 
I of low verbaK^[6il1ty may comprehend material better when taught by programs 

with short, concise senternces containing few unusual words, rather than when 
they are taught by programs with a high verbal content. 

This study (Gilman and Harvll chuck, 1967) tested three hypotheses 
f regarding the verbal content of computer-assisted Instruction programs. The 

* expected findings were as follows: 

1) A low verbal content program requires less Instructional time than a 
high verbal content program. 

2) Greater comprehension (posttest performance) results from having 
studied a low verbal content program, as contrasted with having studied a high 
verbal content program. 

3) There Is a higher correlation between achievement (posttest performance) 
and verbal Intelligence ( California Test of Mental Maturity) for students 
studying a high verbal content program than for students studying a low verbal 
content program. 

Method 

The subjects were 36 students from the tile setting and plumbing programs 
of Williamsport Area Community College, Williamsport, Pennsylvania. The stu- 
dents were selected because they had not yet demonstrated high academic ability 
and had not received previous Instruction In the content materials (significant 
figures) to be used In the study. All Ss were naive with respect to^educa- 
tlonal experimentation. 
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were randomly assigned to two treatment groups of 18 Ss per group. Ss 
were pretested with the five-item pretest. No ^s answered more than two ques- 
tions correctly and most Ss answered all questions incorrectly. 

Both treatment groups received instruction through the 1050 terminal. The 
time required for instruction was recorded by the computer. Immediately fol- 
lowing the instruction, the 18-item posttest was administered. 

Conclusions 

The major conclusions from this study may be summarized as follows: 

1) It is possible to substantially reduce the verbal content of a 
computer-assisted instructional program without significantly decreasing the 
learning which results from a student having studied the program. 

2) The conditions in which instruction is presented by a low verbal con- 
tent program required significantly less time than instruction by a high verbal 
content program. This effect results from the slow type-out rate of the type- 
writer terminal device and the additional time required by students to read 
and comprehend the longer typed message's. 

, 3) Although the difference between the correlation of achievement and 
verbal intelligence was not significant, the results indicated a slightly 
higher correlation between intelligence and achievement on the part of the 
students who studied the low verbal content program. 

Reducing the verbal content of a computer-assisted instruction program 
ha> definite advantages for efficiently utilizing instructional time. The 
time saving can be considerable when a typewriter interface is used. There 
are also advantages for using low verbal content programs with the newer 
CRT interfaces, since these devices cannot accommodate lengthy messages. 

The use of low verbal content materials may also be advantageous for the 
slow learner. Further studies should be conducted with a wide variety of pro- 
gramed materials and with larger groups of subjects to ascertain whether or not 
the lower correlations of achievement and verbal intelligence on the part of 
the students studying low verbal content programs can be replicated. 

The widespread use of programed materials is advantageous to students of 
all ability levels, but particularly to low ability and less literate students. 
For many low ability students, studying materials that are programed may mean 
the difference between comprehending the material and being confused. It Is 



recommended that there should be a greater effort to program materials with as 
low a verbal content as Is possible In order that low ability students can more 
adequately comprehend th? programs. 



. Prior Knowl edge and Individualized Instruction 

Purpose 

This research (Brown and Bahn, 1968) was designed to Investigate a possible 
technique for adapting to Individual differences, specifically for adapting 
Instructional methods to the extent of prior knowledge. 

If a program Is to be responsive to the needs of students who have various 

X 

amounts of prior knowledge, It should possess the following:.' 

1. a means of assessing each student's knowledge of each concept 
or sub-concept prior to instruction? 

2. a means of skipping past material which the student has 
already mastered; 

3. a means of providing a rapid review of the material about 
which the student has some prior knowledge; 

4. a means of providing Instruction on theimaterlal, for which 
the student has little or no prior knowledge. 

^ An effort was made to providt' these four capabilities In a CAI program. 
Three separate techniques were, employed In an effort to prepare a program 

/ • c 

which would be adaptive to the needs of students possessing various amounts of 
prior knowledge. 

Subjects were randomly assigned to each of two programs, 33 Ss were 

■ t 

assigned to the Experimental .Segment (EXS), and 32 to the Modern Mathematics 
Segment (MMS). Subjects were run Individually on IBM 1050 terminals. Each 
subject was administered a 22-1 tern pretest Immediately before going on the 
program, 22-Item posttest, and an 11 -Item transfer test Immediately following 
his completion of the. prpgram, and a 22-Item retention test one week later. 

The pre-, post-, and retention tests specifically Included conversions from one 
base to another, which were taught In the program. The transfer test required 
the Ss to perform addition and subtraction In bases other than base ten. All 



four tests required constructed responses. The reliability estimates for the 
respective tests by Kuder-Richardson Formula 20 are as follows: pretest, .93; 
posttest, .93; transfer test, 93; retention test, .96. 
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Results . 

■ ~ / < 

Students who received non-zero scores on the pretest or who had received /. S 
prior Instruction on numbers systems other than base ten were categorized as 
having prior knowledge (PK) of the content. Students who scored zero on. the 
pretest and had received no prior instruction on numbers systems other than base 
ten were categorized as having no prior knowledge (NPK) of the content. Per- 
formance data, consisting of posttest, transfer test, and retention test scores ^ 
along with Instructional time, were analyzed within a 2 x 2 analysis of variance 
design. One factor consisted of program (MMS or EXS), the other of extent of 
prior knowledge (PK or NPK). 

The results of the analysis of variance of posttest scores for the PK and 
NPK groups indicated that neither of the main effects were significant; however, 
there was a mai^inally significant interaction between extent of prior knowledg^ ! 
and program taken (P <.10) . .•* " 

The results of the analysis of variance of retention test scores for th6. ^ 

PK and NPK groups by program are very similar to the results of the analysis 
posttest performance. The main effect for programs was not significant. The, 
main effect for extent of prior knowledge was significant (P <.05); however, Ss* 
on the posttest, there was a marginally significant Interaction between extent 
of prior knowledge and program' taken (P <.10). 

The results of the analysis of. variance for the transfer test scores show 
no significant differences in retention test performance. 

The analysis of variance results for instructional time Indicated a sig- 
nificant main effect for programs (P <.05). The main effect for extent of , 
prior knowledge as well as the Interaction was non-significant. 

Because of the marginally significant Interaction between program taken . 
and extent of prior knowledge for posttest and retention test data, the simple, » ^ 
main effects were 'calculated. From analysis of the Simple main effects, the 

f' 

following pattern emerges. PK ^s on EXS do significantly better than NPK 
(P.<.05) for the posttest, and (P <.01) for the retention teSt. Ss on.MMS _ 
having PK do not do significantly better than Ss having NPK (F <1 .0),. 
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The simple main effects of PK - NPK across MMS - EXS arenas follows: for 

j ^s having PK there were no significant differences in performance on posttest 

or retention test attributable to the Instructional programs (F <1.0). ^s 
I having NPK did significantly better .on MMS on both posttest (P <1 .0) and 

' retention test (P <.10). 

The EXS program seems to have capitalized on the knowledge which Ss had 
prior to Instruction. The finding of no significant differences between MMS 
and EXS on posttest, tran^sfer test, and retention test, coupled with the time 
saving for EXS, suggests that students with prior knowledge would benefit by 
having Instruction bn EXS rather than MMS. For NPK Ss the lower posttest and 
retention test scores on EXS” seem to call for MMS for these £s In spite of the 
time saving on EXS.' " 

Discussion and Conclusions 

I The procedure reported here seems to provide a means of adapting to extent 

of prior knowledge which results In considerable time saving with no decrease 
In criterion performance. The results of this study also suggest that neither 
of the programs could be recommended for all students If they vary widely In 
extent of prior knowledge. Perhaps parallel programing employing the formats 
. of both the programs with a branphlng procedure for switching students from one 
program to the other may provide the benefits of both. 

I The procedure employed In EXS may have somewhat limited application In 

terms of the Instructional content. The content In this study was such that a 
I student's prior knowledge of a concept could be evaluated. For content con- 

sisting of more or less discrete units of Information, ^valuation of prior 
I knowledge by the method employed here may not be feasible. 
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Response Latency ; Its * Relationship w1 ^ Errors 
and Res^nse Stability in Two Tasks involving 
Response CompetTtlon 

Purpose 

The present study (Berman and Vlllwock, 1969) was designed to Investigate 
the relationship between response latency and the tendency to make an error, 
rather than a correct response, and the tendency to make a stable, rather than 
an unstable response. 

The following expectations were proposed: 

. 1) Students would make more errors and have longer response 

latencies o'n problems which Involved a high degree of response 
competition than on those with little response competition. 

2) Students would have longer test and retest response latencies 
for problems on which the response was cfianged from the test 
to the retest than for problems on wh1cl>"^he response remained 
the same. 

3) In the present study problems were designed so that they would 

be of varying difficulty, with both the error response tendency 

and the correct response tendency varying in strength. However. - 

some Instructions and examples of correct responses were given, 

so that the correct response tendency was probably either 
• # 

stronger than the error tendency or, if it was weaker than the 
error tendency. It was at least moderately strong. 1 1 was , , 

therefore , ^ expected that the response latency for errors would 
be longer than the response latency for correct ‘ responses . 

Method ^ 

Fifty- three college undergraduates from two Introductory courses were 
enrolled In the experiment as paid Volunteers, There were 30 men and 23 women. 
Students were toldVthat they would be paid a flat rate for serving In the 
experiment In two sessions. 

The same computer program was administered to students twice, with a six 
to eight day Interval between the two tests. Students were given Instruction 
and practice using the light pen and typing and entering responses. They were 
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told to answer as .soon as they thought they knew the correct answer and that 
both speed and accuracy Were Important. The two keys used to enter responses 
were covered with red tape and referred to as the "red keys" In an attempt to 
Tadlltate discrimination and shorten response time. Introductory and Instruc- 
tional frames remained on the Interface until the student Indicated his readi- 

4 , 

ness to proceed by pressing the fed keys. 

\ 

Results ' ’ 

The results confirmed two of the study's hypotheses, and were equivocal 
with respect to the third.; 

Students made more errors and had longer response latencies on problems 
which Involved more /Competition between responses than on those with less 
response competition. This was true with both types of problems ^ven though, in 

I 

each, response competition was varied in a different manner. 

In the set tasks the number of responses which appeared relevant to problem 
solution were varied. Single dimension problems could be sqlved by simply 
attending to the one feature of the stimuli on which the two choice figures 
differed. In contrast, the critical feature of the multi -dimension problems 
could be any of a number of dimensions on which the choice figures differed. 

In order to solve the multi -dimension problems students were required to attend 
to each of these stimulus features until they found the critical feature. Irt 
the base problems, the degree to which overlearned habits from base 10 were In 
conflict with new responses associated with other bas? systems, varied. 

The results are perhaps more clearcut for the base problems than for the 
set problems, since the difference between the r^ponse latencies of single . 
and multi -dimensional problems failed to reach iljgnlflcance on the retest. In 
constructing the set figures there were no controls for perceptual variables. 
Instead, perceptual differences were randomly distributed among single and 
multi -dimension problems since the ten sets of stimuli were randomly assigned 
to the two conditions. Perceptual factors were undoubtedly a source of ^ 
significant variability In errors and latency among the five single dimension 
problems, and among the five multi -dimension problems. A possible means of. 
controlling for these differences would be to construct two sets of choice 
figures for each pifoblem, thus creating a single and a multi -dimension form of 
each problem, each to be admlnl^stered to a different group of s^den^. 
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Students took longer to produce errors than correct responses on both 
types of problems . The differences were highly significant and were not due 
to the fact that errors and long latencies were both associated with signifi- 
cant factors such as tost vs. retest, single vs. multi -dimension problems, or 
type of base question asked. These factors had been equally weighted In cal- 
culating students' average latencies for correct and, Incorrect responses. 

<• • * 

In the set problws two response alternatives were given; In the base 

problems students produced a response from an unlimited number of alternatives, 

although the two strongest response tendencies were presumed to be the correct 

% 

response and the response wMch would be correct In the base 10 system. Of 
course, other responses were possible and were. In fact, made. It Is Inter-^ 
estlpg that these other error responses were also associated with longer 
latencies than correct responses. 

Although numerical base Instructions were held to a minimum, they were 
obviously sufficient to establish the correct response as a strong competitive 
response. If It were not so, there would be littl.e competition between the 
correct response and base 10 habits, and "qu1ck errors" based on strong base 10 
habits would probably have been made. After subjects produced each number In a 
series they were told the correct response. Subjects made many errors at the 
power changes. However, the time taken to produce numbers at power changes 
Increased with each power change up to the third or fourth In. the series. This 
Increase In response latency coincided .with decrease In the number of correct 
responses produced by the group. 

^ . 

The procedure used In the present experiment was more like the usual school 
situation In which some Instructions are given, so that the correct response 
becomes a strong. If not dominant, response. However, It Is well to remember 
that the positive association between error rate and latency may be restricted 
to situations where the error response Is not In a strong dominant position. 

In the set task there was no obvious relationship between error' rate and 
mean latency for the ten problems. The correlation between error' rate and mean- 
latency for the nine base problems was .82. 

It should be noted that, idille students took longer to produce error 
responses than correct responses, students who had longer mean response 
latencies did not necessarily make more errors than those with shorter mean 
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latencies and error scores on the retest, but not the test. In contrast, the 
relationship .between .mean latency and error scores on the set problems was 
negative (and significant on the test, but not the retest). The relationship 
may Indicate that more care was taken by students who were more successful, 
and this Interpretation Is supported by the fact that students who spent more 
time looking at the Instructions for the base problems took longer to respond 
to set problems and made fewer errors ori set problems. 

It was expected that students would have longer test and retest response 
latencies for problems on which the response was changed from test to retest 
than for problems on which the response remained unchangfed. Mean latencies of 
‘ changed and unchanged responses within six categories were compared. In all six 
categories the average latencies of changed responses were longer than those of 
unchanged responses, but the difference between changed and unchanged responses 
reached significance In only one category. The number of students with appro- 
priate data to make these tests was small, particularly for the base problems. 
The hypothesis cannot be accepted, based pn the results of the present experi- 
ment, but It Is certainly worth further testing. 



Prompting and Co nfirmation as Modes 
of Feedback wnh~£omputer-Assl steT~Instruct1on 

Purpose ’ * , 

The purpose of this experiment (Borman and Hall', 1969) was two-fold: 

1) to test the assumption that 16 stimulus Items were of equal difficulty; and 

2) to test the relative effectiveness of prompting and confirmation as two modes 
of feedback. It was expected that the stImOTus Items were not, of equal diffi- 
culty; that the stimulus Items would be learned In less time than when presented 
under the prompting mode of feedback; and that the Items would be more readily 

■ remembered after varying periods of time when presented under the confirmation 
mode of feedback. 
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Method 

Forty-three volunteer subjects were obtained from an Educational Psy- 
chology 14 class during the Fall 1968 term at The Pennsylvania State University. 
The S^s were notified that approximately two and one half hours of time would 
be required to complete the study; that they would be required to return to 
the CAI laboratory 1, 7, and 21 days after the Initial training session; and 
that they would be paid J$3.25 for thefr, time. 

Each ^ was randomly assigned to either the prompting or confirmation mode 
of feedback and trained to a criterion of 2 successive errorless Identifications 
of the 16 stimulus materials. The Ss returned to the laboratory 1, 7, and 21 
days following completion of the training session and were administered a reten- 
tion test during which the Ss tried to Identify each of the 6 original stimulus 
Items randomly ordered. Before the first retention test the S^s were adminis- 
tered an opinion survey dealing with their experiences with CAI. 

Findings 

An analysis of variance procedure for repeated measures used to test the 
hypothesis that the 16 stimulus Items were of equal difficulty. The total 
number of trials required to learn each stimulus Item was the depende:it variable. 
Because of the significant Interaction, It was necessary to examine the simple 
effects, I.e., test the effect of the stimulus Item at each level of feedback. 

The least significant difference procedure was used for each level of feedback. 
The Items did differ significantly from each other at both levels of the factor 
"mode of feedback," The order of the Items also differ at both levels of the 
mode of feedback factor. This makes It necessary to analyze the random split 
halves by the orders obtained from both the prompting simple effect and the 
confirmation simple effect. The Items were arranged In descending order from 
most difficult to least difficult for each simple effect. Those Items were 
marked with a P for each level of the criterion. Those Items not so marked 
were taught by the confirmation mode. In the majority of cases, the Items 
taught by the prompting mode of feedback were harder or easier, but not equal 
In difficulty, to the Items taught by confirmation. Also, In the majority of 
the cases the Items actually Included In the split half were^ significantly 
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different from the items which should have been Included 1n the split half. 

Only those items chosen for the prompting mode of feedback at the sixth level 
of criterion did not differ significantly from the ideal split half. . 

To examine the expectation that prompting would facilitate learning, three 
variables; total time to criterion, total number o^ trials to criterion and 
student opinion were examined. A multivariate analysis of variance procedure 
produced an F of 4.80, df =* 3.39. P <.01 Indicating that significant differ- 
ences did exist among the groups. 

The Ss who learned the Items by the prompting mode of feedback required an 
average time of 87.69 minutes (S. D. = 31 .21) and an average of 7.36 trials 
(S. D. * 2.90) to reach criterion while the ^s who learned the Items by the 
confirmation mode of feedback required an 'average time of 98.70 minutes 
(S. D. • 32.97) and an average of 10.55 trials (S. D. = 4.95) to reach crite- 
rion. A t of 2.54, (df - 19) was significant at .05 level for the average 
number of trials to reach criterion Indicating that the prompting Ss took 
fewer trials, but the same amount of time to learn the Items than did the con- 

flrmation S_s. 

In addition, the student opinion scores obtained 1 day after training 
showed the prompting Ss to have a significantly (.05) more positive attitude 
toward CAI than the confirmation Ss. 

The expectations that confirmation would produce higher levels of retention 
than prompting was tested by analysis of variance for repeated measures. 

Although the F « 1.18 for mode of feedback was nons ignifican t, a trend did exist. 
Because of the tendency of the two groups to merge 7t 21 days, the authors 
hypothesized that the curves would cross after a longer period of time had 
elapsed after training. , To test this, a fourth retention test was administered 
after an Interval of 90 days from the time of training. Thi rty- three Ss were 
available at that time and were willing to take a fourth retention test 
(N prompting - 18, N confinnatlon « 15). . Ninety days after training, the 
prompting Ss missed an average of 8.6 Items (S. D. « 3.11) and the confirmation 
Ss missed an average of 9.6 Items (S. D. - 2.77). The difference was not signif- 
icant, and the curves did not Intersect. 

Analysis of covariance procedures were used to adjust for the unequal 
number of trials and unequal amounts of time spent by the ^s In the various 
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treatments o It was assumed that If a person spent more time, or required a 
large number of training trials, that his level of retention would be corre- 
spondingly higher. However, analysis of covariance procedures using total 
time to criterion and total number of trials to criterion as covariants did not 
change the results. 

I 

Discussion 

It was shown that the 16 stimulus Items were not equally difficult as 
assumed by Hall and Borman (1968). The data contained in this report suggest 
that one of two procedures be followed 1n further studies to avoid this error: 

1) that all treatments be prwented with all' of the stimulus Items as was done 
in the current study; 2) that patched groups stimulus Items be formed on 
the basis of the data presented in this paper. For example, once the stimuli 
have been ordered on the basis of difficulty, one could then assign pairwise 
Items to alternate groups on a random basis. This procedure would assure that 
the two groups would have items of similar difficul ty levels. 

It was also shown In this paper that the prompting mode of feedback 
required fewer trials to master the Items than did the confirmation mode of 
feedback even though both groups consumed equal amounts of time. This finding 
may be accounted -for by examining the logic of the pgm. The stimulus drawing 
and the name of the drawing appeared simultaneously to the students In the 
prompting mode. The student could then spend as much time as he pleased 
studying the Item before he typed his response and went on to the next Item. 
However, for students In the confirmation mode, once the student typed his 
answer and the correct name appeared on the screen, the student only had between 
8 and 10 seconds to study the stimulus and correct name together before mov1>^g 
on to the next Item. In order for the student In confirmation mode to have an 
equal amount of “study time", he would be required to go through more learning 
trials. Amount of "study time" Is a variable that should be controlled In 
further experiments of this nature. 

The authors have also arrived at the conclusion that an additional source 
of variance was Introduced into the task and not accounted for. Each stimulus 
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item consisted of two concepts: A means of fastening an object (weld, flange, 
screws etc.) and the object (elbow, valve, joint, sleeve, etc.). The authors 
currently hypothesize that students may have tried to form concep^ for weld, 
screw, flanged, elbow, joint, sleeve, etc.. Instead of memorizing the name 
that appears with the item. This concept formation procedure by the students 
may have contributed an additional source of error variance, possibly hiding 
any effect^ due to prompting and confirmation as inodes of feedback. In the 
future the authors plan to control this source of variance by keeping the means 
of fastening tfie object constant and eliminating that concept from the response. 
Materials are currently under development to permit the execution of this design. 



Reading Rate and Retention Under 
Modes 0^ Presentation 

Purpose 

The present study (Brown, Dwyer and Hollick, 1S69) Is focused on the 
Investigation of one stratef^ for optimizing reading rate. A response sensitive 
external pacing technique was employed whereby reading rate was adjusted on the 
basis of frequently assessed Immediate recall. The effects of adaptive external 
pacing on reading rate. Immediate recall, and delayed recall were Investigated. 
The experiment was Implemented on the IBM 1500 CAI system In the Computer- 
Assisted Instruction Laboratory at The Pennsylvania State University. 

Method 

Forty-two students from Introductory educational psychology and psychology 
classes at The Pennsylvania State University served as subjects. The students 
were paid for their participation In the experiment. ^ 

Procedure 

Each S received 30 of the 60 passages under self-paced presentation and 
30 under externally-paced presentation. Sjs were randomly assigned to two 
groups; one group received the self-paced presentation first (SPF) and the 
other the externally-paced first (EPF). Within each group each S was assigned 
to one of four random orders of presentation of the passages. 



In both the SPF and EPF conditions each passage was followed by three 
questions. Following the third question on each passage the was given feed- 
back Indicating which of the questions he answered correctly or Incorrectly. 

In the EPF condition the student's performance was evaluated following 
each set of questions and on the basis of a simple set of decision rules the 
reading was set for the passage: 

1) If the S_ answered all three questions correctly, the rate was 
Incremented for the next passage. 

2) If the S_ answered less than two of the three questions correctly, 
the rate was^decremented. 

3) If the S_ answered two questions correctly and 1f he had answered 
all three correctly on the previous passage, the rate remained 
unchanged for the next passage. 

For the first ten of the 30 passages under the EPF condition. Increments 
or decrements were 1n steps of 25 words per minute. For the second ten 
passages, steps of 15 words per minute were employed, and for the last ten 
passages the Increments or decreme.nts were 1n steps of 5 words per minute. 

. The rate for the first passage 1n the EPF condition was set at 225 words per 
minute on the basis of data from a pilot study. 

The ^s were run Individually on the IBM 1510 CRT.- Performance records 
were recorded for each Ss via the IBM-1500 student records program, ^s returned 
one week later and were given a 60-1 tern retention test made up of one Item from 
each of the 60 passages. 

Resul ts 

Inadvertently 22 ^s were run 1n the SPF condition and 20 In the’ EPF-con-, 
ditlon. To achieve equal Ns two Ss from the SPF condition were picked at random 
and their data were excluded from the analysis. 

The repeated measures analysis of variance was utilized to analyze the 
data. This analysis produced the following results. The externally-paced con- 
dition resulted 1n faster reading rates (P <.01). The carry-over effect of EPF 
coupled with what seems to have been a warm-up effect resulted 1n a significant 
Interaction (P <.05). For the Immediate ‘recall scores, the effect attributed 
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to differences between the two pacing conditions was significant (P <.01 ). The 
self-paced condition produced better limedlate recall than the externally-paced 
condition. Retention test scores showed no significant differences. 

While the self-paced condition did produce significantly higher Immediate 
recall, the external ly-f-paced condition produced significantly faster reading 
with no observable decrease In, retention. Given this set of conditions, one 
should perhaps ask how Important Immediate recall differences of approximately 
four Items- may be, especially In light of almost Identical results on retention. 
Perhaps the gain In reading rate In some conditions might be more Important 
than a loss In Immediate recall. The substantive significance of differences 
as well as the statistical significance should be considered. 

Correlation coefficients .for the EPF and SP^ conditions were run. Several 
Interesting and some rather puzzling observations can be madp concerning the 
coefficients. The overall pattern Is one of higher correlations In the EPF 
group. Response sensitive external pacing should largely rule out the effects 
of Idiosyncratic pre-dlsposTtlonal characteristics on reading rate. If a con- 
struct such as optimal Information processing speed Is hypothesized, then the 
positive correlations of reading rate with recall and retention In the EPF con- 
dition would seem to indicate that the EPF, externally-paced condition did 
assign Ss to rates which were appropriate. The continued positive relationships 
seen for EPF self-paced seems to Indicate some transfer effect of the rate 
established In EPF externally-paced conditlor 

The generally low correlations under externally-paced presentation In the* 
SPF group are difficult to explain. Perhaps starting at a rate differing, from 
the rate established In the self-paced presentation had a disruptive effect 
which Is reflected In the lower correlations for this group. Perhaps further 
light will be shed' on the result by additional studies employing modifications 
of the" decision Pules employed In this experiment. Further Investigation of 
Individual difference variables In relation to rate and retention Is planned. 
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CHAPTER VII 



FLOWCHARTS 



i. 



M 



As mentioned In Chapter II, flowcharting was one of the most Impontant 
activities of the project. Chapter II gives the principles of flowcharting and 
explains 9 sample flowchart. The present chapter devotes Itself to a descrip- 









tion of the Instructional flowcharting strategies developed In thjs project. 



Course flowcharts, section flowcharts, and question-level flowcharts will be 
described. For a more complete description, see Teaching Strategies and Tactics 
for Computer-Assisted instruction , (Dwyer, 1970j. ■. * 
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Course Flowcharts 



Strategies Informing 
Student AFout Content 
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Students may be able to proceed through a course wjth great isgccess If 
they are Informed about the objectives of the course. Knowing what Is expected/; 
of them, the students can work effectively toward the objectives. :/ C' 

Objectives of course presented to student . This procedure keeps the stu- ‘ A 

dent Informed about what Is expected of him and .of his progress. Alternate 
approaches can replace presentation of the objectives of a unit w1 th^esenta- ,A 
tion of concepts th^t are to be acquired and skills that should be deVffroped or < 
the presentation of' key questions the student answers (see Figure 4)< ' ^ 

Objectives Stated Prior to Module Instruction with Option ^ Repeat Module .* 

Through this proceddre the student Is Informed of the objectives of the unit, 
enabling him to follow Instructions more knowledgably. In addition, as the. unit 
Is summarized by modules, the student can select those he should-repeat (see 

h ' • , 

Figure 5). 
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Strategies Based on Performance ^ 

A common technique In computer-assisted Instruction Is to accumulate data,' 
on the Individual student's aptitude or his performance while taking the course 
and then tq^e this Information %6 determine what path the student should follow. 
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Key ^ Flowchart - Objectives of Course Presented to Student 

1. Start 

2. Broad objectives of course presented 

3. Objectives of unit n are presented to the student at the student's 
level of understanding 

4. Instruction designed to achieve each oi the objectives of unit n 

5. Each objective of unit n Is presented once again to the student, and 
he Is asked to judge whether he has achieved each objective. 

6. Do you want to select any sections for additional Instruction? 

7. Do you want additional Instruction on objective n of unit n? 

8. Additional Instruction on objective n 

9. Has s^tudent had the option to receive additional Instruction on all 
objectives of unit n? 

10. Quiz yn unit n 

11. Analysis of quiz results to determine which, 1f any, of the objectives 
were not achieved 

12. Is reniedlal Instruction required? 

13. Remedial Instruction on sections determined by results of quiz 

14. Quiz questions on those sections that required remedial Instruction 

15. Was criterion met on the quiz? 

16. Proctor message 1s sent to proctor station Indicating the specific 
deficiencies of the student; off-line Instruction would be given. 

When the student had achieved criterion on an off-line quiz similar 
to his most recent quiz. Instruction then could proceed. 

17. Next unit of course 
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Objectives of Course 
Presented to Student 
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Fig. 4. Objectives of course presented to student. 
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Key to Flowchart 

_ Objectives Stated Prior to Module Instruction w1 th Option ^ Repeat Modules 

1 . Start 

2. Objectives to be achieved In unit n ire presented 

3. Module of Instruction In unit n 

4. Is this the first time the student has received the Instruction 
In this module? 

5. Have all modules In the unit been presented? 

6. Sunmary of unit n 

7. Do you wish to repeat any of the modules In unit n? 

8. Module Is selected 

9. Has entire course been presented? 

10. End 
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Objectives Stated Prior ^ Module Instruction 
with Option ^ Repeat Modules 





Fig. 5. Objectives stated pfTbr to module instruction with option to 
repeat modules. ^ 
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Sequence based on diagnostic tests . Here the student is Introduced to the 
program, receives basic directions, and Is given a diagnostic test to determine 
the help he needs. Based on test results he Is branched to appropriate Instruc- 
tion, given an exercise on what he learned and a posttest to determine the 
extent of his learning (see Figure 6). 

Course presentation In three tracks . Instruction for the below average 
student contains a minimum number of concepts and drill work; for the average 
student, basic concepts, additional concepts, and some applications of more 
advanced exercises; and for the above average student, all concepts, enrichment 
material, and advanced exercises. At specific points decisions can be made 
regarding the student's needs (see Figure 7). 

Flexible strategy for slow , av erage , and advanced students . This strategy 
allows for slow, average, and advanced students to proceed through a course. 

The advanced student has the shortest and most direct route through the course. 
Each student receives a body of Instruction and questions. Students are 
branched to remedial, review, or advanced materials according to performance on 
criterion Items (see Figure 8). 

Shorter sequence for better students . This procedure allows the better 
student to get through the material at a rapid rate, but It also presents a 
review of the type of material he may elect to skip (see Figure 9). 

Sequence and review based on errors made . Here the student Is given a 
choice of a quiz first. The quiz Is analyzed and a branch Is made depending on 
the number of errors. . If errors are greater than an established percentage, 
the student Is branched to Instruction. If the number of errors Is less than' 
an established percentage, he Is given a review of those Items he answered 
Incorrectly. If he has no errors he proceeds (see Figure 10). 

Hierarchical Instruction beginning £t highest competency of student . Thi s 
technique Is used In disciplines like math and physics which lend themselves to 
a hierarchical design. Here the content of a course can be separated Into com- 
petehcles which 4re related In such a manner that capability In certain areas 
Is a prerequisite for success In areas higher In the hierarchy. The course can 
begin with a quiz on the skills and concepts In the highest competency In one 
branch of the hlerafchy. If criterion Is met on the quiz, another branch of 
the hierarchy can be entered. If criterion Is not met on the quiz, a quiz can 
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Key to Flowchart - Sequence Based on Diagnostic Tests ^ 

1 . Start 

2. Introduction to the computer and basic directions 

3. Diagnostic test to determine the concepts with which the student 
needs help 

4. Student's score on concept n In diagnostic test Is evaluated. If 
student understands concept n well enough to achieve the desired 
criterion on the diagnostic test, he Is branched to further Instruction 
on concept n (block 5). If student meets the criterion level, he Is 
branched to the next decision point »»here It Is decided whether or 

not he meets criterion on concept n 1 (block 6). 

5. Instruction on concept n 

6. Have the results of the diagnostic test been used for all concepts 
tested? 

7. An exercise Is provided In which the student uses the material under 
study 

8. A posttest similar to the diagnostic test Is given and results used 
to evaluate student's learning 

9. Stop 






Vrom Penn State's course segment Spelling , Project 5-85-074, IBM 7010 or 
1410; authors: Helen L. K. Farr, Harriett A. Hogan. 
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Sequence Based on Diagnostic Tests 
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Fig. 6. Sequence based on diagnostic tests. 
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Key to Flowchart - Course Presentation In Three Tracks 

1 . Start 

2. Analysis of pretests 

3. Should Instruction proceed In the track for above average achievers 
(track 1)? 

4. Should Instruction proceed In the track for average achievers (track 2)? 

5. Highest level presentation (track 1) of Instruction on concepts In 
section n 

I 

6. Criteria questions In track 1 on concepts presented frost recently 

7. Should enrichment activities or advanced exercises be Included here? 

8. Enrichment activities or advanced exercises 

9. Decision Is made and recorded whether the track of presentation should 
be lowered to average- level instruction 

10. Have all sections In this unit been presented? 

11. Average-level presentation (track 2) of Instruction on concepts in 
section n 

12. Criteria questions In track 2 on concepts presented most recently 

13. Decision Is made and recorded as to whether or not the track of presenta- 
tion should be raised, lowered, or remain In the average track 

14. Below-average presentation (track 3) of instruction on concept(s) In 
section n 

15. Criteria questions In track 3 on concepts presented most recently 

16. Should a recapitulation of the Instruction be given? 

17. Recapitulation of recent Instruction 

18. Decision Is made and recorded whether the track of presentation should 
be raised or remain at the below-average presentation 

19. Unit exam is given and grades are assigned by consideration of exam 
score and most recent track of presentation 

20. End of Instruction or next unit 






Course Presentation In Three Tracks 




Fig. 7. Course presentation In three tracks. 



Key to Flowchart Flexible Strategy for Slow, A verage . and Advanced Students 

/ 

1 . Start 

2. Instruction and questions on concept n for all students (slow, average, 
and advanced) 

3. Quiz on concept n 

4. Is the score on the quiz Indicative of a need for review? 

5. Does the score on the quiz Indicate that the student has a background 
for advanced work? 

6. Advanced Instruction and questions 

7. Does the student need review on the advanced Instruction? 

8. Hore advanced Instruction and questions 

9. Review on advanced Instruction just presented 

10. Review Instruction and questions 

11. Does the student need add1t1ona4 remedial Instruction? 

12. Remedial Instruction and questions 

13. Have all concepts been presented? 

14. End 






126 



Flexible Strategy for Slow , Average , 
and Advanced Students 
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Fig. 8. Flexible strategy for slow, average, and advanced students 
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Key to. Flowchart - Shorter Sequence for Better Student 

1. Start 

» ' 

2. Presentation of section n ' 

3. Quiz 

4.. Did the student know the content well enough to proceed? 

5, Rapid preview of the next section 

6. Student is* asked whether he would like to skip the next section 
'7. Is there more material to present? ^ 

8. End or test • ' 
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Shorter Sequence for Better Student 
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Key ^ Flowchart - Sequence and Review Based on Errors Made 




1 

I 

1 ■ 
/ 

1 

1 

! 

1 
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1 . start . . 

2. Choice of Instruction or quiz • 

3. Instruction which could Include .any number of steps 

4. Quiz on Instructional material from Block 3 

5. Branch depending upon number of errors In quiz: (If there are no , 

errors^, student goes on to new section. If criterion was met, 
student Is given reylew on the jijuestlons he answered Incorrectly. 

If criterion was not met, student Is branched back to Instruction.) 

6. Review Is available on all questions; however, student is given 
review on questions he answered Incorrectly 

7. Continuation of course 
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From Penn State's course segment Sclenti fic Notation, Project No. 5-85-074 
IBM 7010 or 1410; author: Joseph Ritchey. 
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Sequence and Review 
Based on Errors Made 
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Fig. 10. Sequence and review based on errors made, 
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be administered on the next lower level of the hierarchy. If criterion is met, 
instruction begins at the next higher level of the hierarchy; if criterion 1s 
not met, a quiz would be adm-'nistered on the next lower level until a level was 
found for which the stud'" had the necessary prerequisites (see Figure 11). 

Student-Selected Sequences 

There are instructional sequences wherein it may be desirable to deviate 
' from a definite order of presentation within a specified framework and allow 
the student to make a choice in regard to the presentation of material. Options 
could be to skip a section of a course, select the order to study required 
topics, o,r choose to review or not. 

Student choice of additional practice or test . The student has the choice 
of receiving an explanation, practice problems, or a test. The only difference 
between doing practice problems and the test is that during the test, counters 
are used and the student must answer so many consecutive problems correctly In 
, a certain period of time in order to proceed to the next section (see Figure 12) 

Student given option to skip section of course . For each section, the 
student is. given a preview and an option to skip that section. After all the 
sections are completed or skipped, the student is tested on those sections he 
selected to skipo If the ‘test reveals insufficient competency, he Is branched 
back to these sections for instruction (see Figure 13). 

Type of sequence through course chosen by student . Student is given the 
choipe to proceed through the regular programed sequence, a self-structured 
seqij'ence, or a quiz. If he chooses the regular programed sequence, he goes 
through each of the concepts in order and then to the quiz. If ho chooses the 
self-structured sequence, he can go through the instruction on the concepts and 
quiz questions on each concept in any order he chooses. If he chooses the quiz, 
he gets an opportunity after the quiz is completed to choose the concepts he 
would like to review. Depending upon his score on the quiz and the way in which 
. he has chosen to go through the program, he is given various kinds of feedback. 
The feedback may consist of his score, an explanation of those questions he 
answered incorrectly, an explanation that goes along with each, item under each 

* t 

multiple-choice question that student can choose, and a statement telling him 
on which concepts he has shown competencey (see Figure 14). 



Key to Flowchart 

Hierarchical Instruction Beginning at Highest Competency of Student 

/ N 

This flowchart gives the logic involved in one branch of the hierarchy of 
the course content. 

1. Start ^ * 

2. ' Quiz on the competencies of the highest, level of this branch of the 

hierarchy 

3. Was criterion met on the quiz? 

4. Quiz for the competencies at the highest level of another branch of 
the hierarchy 

5. Did the student come to the criterion quiz after receiving instruction 
at the highest level of. this branch of the hierarchy? 

6. Quiz on the competencies of the next lower level (level 2) of the 
hierarchy 

7. Was criterion met on the quiz? 

8. Has student received instruction at this level two successive times 
without achieving criterion? 

9. Instruction on the highest level (level 1) of this branch of the 
hierarchy; (The instruction may include remedial instruction for the 
student passing through the instructional sequence a second time 
after falling to meet the criterion on the quiz.) 

10. Quiz on the competencies of the next lower level (level 3) of this 
branch of the hierarchy 

11. Was criterion met on the quiz? 

12. Instruction at level 2 of this branch of the hierarchy 

13. Processing may continue in one of three ways: 

a. Quiz on the next lower level of . the hierarchy with the same 
logic being followed as the logic for other criterion quizzes 

b. Branch to another section of the course which is considered to 
be a prerequisite for this branch of the course 

c. Instruction at this level, which would be the lowest level of 
this branch of the hierarchy 
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Hierarchical instruction Beginning at 
Highest CompetWy of Student 




Fig. n. Hierarchical instruction beginning at highest competency 
of student. 
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Key to Flowchart - Student Choice of Additional Prac tice or Test 

1. Explanation of options available; student makes his selection 

2. Did the student choose to take the test first rather than having the 
explanation or practice? 

3. Zero Is loaded Into switch n which records that the student Is doing 
problems for -the test 

4. Did the student choose to have the explanation of procedure? 

V 

5. Explanation of procedure Is given and the student proceeds with 
practice problems 

6. One Is loaded Into switch n which, records that the student Is doing 
problems for practice 

7. Problem randomly generated by the computer Is presented to the student 

8. The student responds 

9c .Was the response correct? 

10. Branch depending upon switches and counters; (If student Is doing 
practice problems or has met the criterion on the test, response 
latency Is given next. If more test problems are required, student 
receives a new problem.) 

11. Counter used to count number answered correctly In test Is Incremented 

12. Response latency typed out to student at end of each p jctice 
problem and end of test 

13. Branch depending upon whether student Is doing practice problems or 
the test 

14. Student has choice of more practice problems or the test 

15. Branch depending upon response latency on the test 

16. Next section of course similar to this one 

17. Initialize to zero counters and switches for student taking test In 
order to record how many consecutive problems answered correctly 

18. Since student, did not match the correct answer, the correct answer Is 
stated along- with an example of how It was arrived at 

19. Is student taking test? If student Is doing practice problems, he 
goes back to the same question and answers It again; If doing test, 
counters and switches are Initialized to zero 
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Student Choice of Additional. Practice or ‘Test 
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Key to Flowchart - Student Given Option to Skip Sections of Course • , 

1 . Begin 

2., Preview of section n, Including a content outline 

3. Is the student following a flexible sequence? (This can be determined 
by a pretest, by the Instructor, or by previous work In the course.) 

4. "Do you want to skip th1s> section?" 

‘5. Pres6ntat1on to section n material 

6. Did the student know th.e material ^well enough to proceed? 

7. Remedial Instruction given on section n ' 

8. Student is all owed .to decide whether or not lie will receive a repeat - 
presentation of. the material In the section just covered; option Is 
given even If studeht achieved criterion 

'9. Has -the student been through the entire course prior to this? 

10. "Did the student skip section n?" Beginrilng with the first section; 

^ a check is made to determine which sections were skipped' 

1 1 .. Test on section n - 

12. ' Did the student do well enough on the test? 

13. "Do you want to study section n?" Option is given even^ though 

cri terion was met « ' 

1.4. Has student completed or been 'tested qn all sections? 

1 5 . End ■ , . 



3 

From Penn State's course segment Audiology , Project No. 5-1194, IBM 7010 
or 1410; authors; Bruce M. Slegenthaler, Jeffrey Katzer. 
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Student (alven Option ^ 
Skip Sections of Course 
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Fig. 13. Student given option to skip sections of course. 
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Key 0 to Flowchart - Type of Sequence ■ Through Course Chosen ^ Student^ 



1 . 

2 . 

3. 



6 . 

7o 



8. 



9. 

10 . 

11 . 

12 . 

13. 

14. 

15. 

16. 

17. 

18. 



Start 

Introduction 

Choice of programed sequence (A), self-st»^jctured sequence (B), or 



4. 

5. 



quiz .(C) 

- ✓ . 

Instruction on. concept n^ 

Branch depending on choice made in step 3; for the regular programed 
sequence, steps 4 and 5 are repeated as many times as. the number of 
.concepts to be presented, each time a. new concept being presented. 

Have all concepts been presented? ' 

Choice of instruction on any of the concepts or the qui.z.on these 
concepts 

Quiz on concept n; for regular programed sequence, quiz includes all 
concepts • 

Branch depending on choice made in step 3 (A, B, or c) 

Score on most recent questions revealed to students and opportunity to 
review specified concepts given and carried out 

Branch depending on choice made in step 3 (B or C) 

Branch depending on, total quiz score 

Student told that all answers were correct' 

Branch depending on choice made .in step 3 (A, B, or C) 

Statement made to student cqncerning completion of instruction 

End 

I 

Branch made depending on choice made in step 3 (A. B. or C) 

Student is told on which concepts he is competent and those on which 
he needs instruction 'V 



19. 



20 . 

21 . 

22 . 



Choice of going to end or back to po;lnt where choices can be made of 
the concepts on which to receive instruction 

Explanation given on each response which was incorrect 



23. 



•Branch depending on choice made in step 3 (A or B) 

Student, can select from al l quiz questions and receive explanations 
regarding them 

Student can choose whether to go to end or to be given opportunity to 
review 



^From Penn State's course segment Educational Measurement, - 
Project No. 5-85-074, IBM 7010 or .1410;* authors: , Keith A. HaTl and 
Harold E. Mitzel . 
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Type of Sequence Through Course 
Chosen by Student . 

A. Regular Programmed Sequence 

B. Self-Structured Sequence 

C. . Quiz 
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Fig. 14. Type of sequence through bourse chosen by student. 
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Student-control of course content. A "map" of the entire course Is shown 

— ' V J 

to the Student at the. beginning of the course. The map would consist of Inter- 
' related blocks containing the topics Included In the course. The* student may 
select any segment of this map for further scrutiny. At this point he Is given 
a more close-up view of the segment that he selected. He can continue this 
process of going deeper and deeper Into the course material or Into the maps, 

. or he\can Indicate that he wants to withdraw one step or move sideways to 
another map region at the same level 1n which he Is working. At any. time, the 
student may go back to the main map (see Figure 15).’ ^ ^ 

Student choice to receive explanation of quiz questions and/or review. 
Student receives Introduction, then Instruction; he then has a choice of 
reviewing the Instruction, stopping until a later time, or continuing with 
more 1nstruct1on<fol lowed by a two-part quiz. At the end of part 1 of thq quiz, 
the student has the option of, receiving an explanatfon of any or all of the 
questions. After receiving the explanations or deciding not to receive them, 

■ he proceeds;, to the second^part of the quiz'. -H1s score 1s given at the ^nd of 
the entire quiz. He then has the option of going on to the next chapter, 
repeating this chapter, or stopping (see Figure 16) 4 

Student-adapted multi-level Instruction . A course can be comprised of 
several Independent blocks of Instruction. Strategy may allow the student to 
select the order he will enter the blocks of Instruction. When a block Is 
entered, the student first receives a diagnostic test on the content of the 
block; if performance Is satisfactory, the block Is exited; otherwise, the 
student will receive Instruction followed by a criterion test. If criterion 1s , 
not met, the student can choose h1s next block of Instruction. Within each 
block, the student may ele^t-to enter review and request help routines (see 
Figure 17) . ** 

t ' ^ • 

Section Flowcharts 

The strategies presented here represent sections of a course. Many Include 
programing over several questions or frames, such as those giving cumulative 
feedback relative to a set of questions. 
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Key ^ Flowchart - Student-Control of Course Content 

1. Start 

Main map of the course Is shown to student; (sections on the main map 
could be descriptive chapter titles) 

• « 

3. Did the student choose to explore section 1 further? 

4. Sections 2,' 3, and so bn, all of which have flow similar to section 1 

5. Map Indicating subsections of section 1 Is shown to the student; 

(this map could be chapter subtitles) 

6. Was "main map" chosen? 

7. Was a related section at the same level selected? 

8. Was subsection 1 chosen by the student? 

,9. S^Jasectlons 2, 3, etc., of section 1; -ach Is similar In flow to 

subsection 1 , ' . 

10. Items for study within subsection 1 are shown In map form to the 
student 

11. Was "main map" chosen? 

12. Was a related subsection at the same level selected? 

13. Was the subsection map for section 1 selected? 

14. Was Item 1 of the map selected? 

15. Items 2, 3, and so on of subsection 1; the flow In each Is similar 
to that of Item 1 

16. Instruction on Item 1; (within each phase of Instruction, the stj/ident 
Is allowed to select different topics for study by Choosing other 
parts of the course map) 

17. Did the student choose to go back to the "main map?" 

18. Did the student select related Instruction In subsection 1? 

'19. Did the student select the subsection map for section 1? 

20. Did the student select the Item map In subsection 1? 

21. Continuation of Instruction on Item 1 
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Key jto Flowchart 

Student Choice to Receive Explanation of Quiz Questions and/or Revi ew^ 

1. Start 

2. Introduction to the course segment 

3. Beginning of instruction 

4. Student Is given option to receive either a review of previous Iris true 
■ tion, or Instruction on new material 

5. Review of previous Instruction 

6. Instruction presented on new material 

7. Part 1 of quiz 

8. "Do you want an explanation of question 1 In part 1 or quiz, or 
all questions explained?" 

9. Explanatioji of question n 

10. Kas option for all questions been given? 

11. Do you want an explanation of next question? 

12. Explanation of each question In Part 1 of quiz 

13. Part 2 of qui^ 

14. Feedback Is given: "Your score for Part 1 and 2 of quiz Is ." 

15. Student Is given option to proceed to the next section; repeat 
this section; or stop 

16. Next section 

17. Stop 



^From Penn State's course segment Manag^ent Accoun t1 ng , Project No. 5-1194 
idM 7010 or 1410; authors: Joe J. Cramer and Carl R. Palmer. 
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Student Choice ^ Receive Explanation 
of Quiz Questions and/om Review 
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Fig. 16. Student choice to receive explanation of quiz questions and/or 
review. ' 
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Key to Flowchart - Student-Adapted Multi-Level Instruction^ 

1 . Sign on 

2. Introduction to course: list of topic areas 

3. Has, student completed smear technique? 

4. Did student elect to enter smear "technique? 

5. Diagnostic test: smear technique 

6. Was student performance satisfactory? 

7. Instruction: smear technique 

8. Does the student wish to review?. 

9. Review: blood smear technique 

10. Criterion test: smear technique 

11. Is remedial work required? 

12. Remedial: smear technique 

13. Has criterion been reached? 

14. Has student completed stage Instruction? • ^ 

15. Did student elect to enter stage Instruction? 

16. Diagnostic test: stage Instruction 

17. Was student performance satisfactory? 

18. Instruction: stage, discrimination 

19. Does the student wish to review? 

20. ’ • Review: stage discrimination 

21 . Stage drill 

22. Has student requested assistance? 

23. Assistance: stage drill 

24. Has student completed the drill 

25. Criterion test: stage discrimination 

26. Has student completed species diagnosis? 

27. Does student wish to enter species diagnosis? 

28. Diagnostic test: species diagnosis 

29. Was student performance satisfactory? 

30. Instruction: diagnostic properties 

31. Is further Instnictlon required? 

32; Instruction: aWlfact discrimination 

33. Is further Instruction required? 

34. Does the student wish to review? 

35. Review: species diagnosis 

36. Species drill 

37. Criterion test: species diagnosis 

38. Has student completed all sections? 

39. Off-line microscope test 
^*40. Is remedial work required? 

41. Remedial: species diagnosis 

42. Sign off 



^From Penn State's course segment Laboratory Dlggt^osls of Malaria , Office 
of Naval Research, Contract No. N00014-67-A-0385-0003, IBM 7l5JO or 1410; 
authors: CDR M. Stirewalt Lincicome, MSC, DSN; Richard Beaudolnj HMC Deari 
Armstrong, DSN (Ret.); HMl Arthur Wentland, USN; Leslye Bloom. 
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F1g. 17. Student-adapted multi-level Instruction.' 
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Giving Cumulative Feedback 

% 

One of the primary advantages of computer-assisted Instruction is the 
* % 

facility each student Is glveiTby providing feedback concerning his progress. 
After Information Is accumulated about the student's performance, problems can 
be assigned to additional Instruction or drill. ^ 

‘ Indicating response latency to student . Each time the student answers a 
question, his response latency Is added \o a counter. When his answer Is pro- 
cessed, he Is told whether he Is right or wrong and how many seconds he spent 
on the question (see Figure 18). 

Testing student and giving feedback to student and proctor . This routine/ 

Is designed for a test situation. The test Is written In a manner that will / 

/ 

present ten problems one at a time with the answers and problems remaining / 
visible. When the student completes the last problem, the program analyzers 

' ' , • ■ Cr • 

all answers and Indicates to the student whether each answer Is correct (see 
Figure 19). 

Giving Information to proctor when student completes an Instructional 
session . When a student has completed an Instructional session. It may be 
desirable to have Information on his performance: what part of the course he 
completed; how many questions he answered In session; how many questions he 
answered correctly on first attempt; how many times did the student time-out; 
•and how many minutes was the student on the course (see Figure 20). , 



Flexible Course Flow c 



One of the difficulties with conventional classroom teaching 1s that the 
Instruction cannot be made suitable for a wlde^ range of capablll ties and 
interests. CAI courses can be programed to allow for individual differences 
and difficulties. ' 

Student control of course flow . In the Initial development pf a course 
the author cannot be certain that the selected content and organizaitlon of the 
coursfe'^s the most efficient for achievement of the objectives of the course. : 
Even aft4 r revisions are made on the basis of student performance and observa- 
tions by the students. Instructor, and others, a, program which does not allow 
for Individual differences may not achieve the objectives efficiently. " 
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Key to Flowchart - Indicating Response Latency ^ Student ^ 




1 . Start 

2. Initialize to zero counter used to accumulate response latency 

* I 

(counter n) 

3. Update restart record so that If student signs off before the problem 
Is completed correctly, this will be the restart point 

s 

4. Show the proper Image on the Image projector 

5. Display the statement: Examine the Im^ge. What Is the atomic number 
of sodium? 

6. Student may respond to the question 

7. Add response latency to counter n . 

8. Is answer correct? If so, go to 9, if not, go to 10 

9. Display contents of counter n within the statement: It took you 

seconds to answer the question correctly 

10. Display counter n within the statements: Wrong. You have now 

spent seconds trying to answer this question 

11 . Next problem 






O* 



^ From Penn State's course segment Atomic Energy , Project No. 5-85-074, 
IBM 7010 or 1410; author: David A. Gilman. . 
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Indicating Response Latency to Student 
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Fig. 18. Indicating response latency to student. 
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Key ^ Flowchart - Testing Student and Givi ng Feedback to Student and Proctor 

1., Start 

2 . Display example problem on the image projector 

3. Display one problem and allow student to respond 

4. Is student's response correct? If so, go to 6; otherwise go to 5 

5. Load 0 into appropriate switch 

6. Load 1 into appropriate switch , 

7. Move the problem label (A, B, etc.) into a buffer area for later use 
to display to proctor which problems were correct 

8. Add 1 to total -correct counter 

9. Are all the test problems displayed? If not go to 3; otherwise go 

to 10 ■ i ^ 

10. Test the switch recording'correctness ft each problem. If equal to 

zero, go 'to 11; otherwise go to 12 . 

11. Indica^ a wrong answer by placing the letter 'w' beside the appro- 
priate problem label and go to 13 ; ' 

12. Indicate a correct answer by placing the letter 'r' beside the appro- 
priate problem label and go to 13 . 

13. Have all switches been tested? If so, go to 14; ‘otherwise go to 10 

14. Send proctor message; that is, display contents of appropriate buffers 
counters, and switches at proctor station > 

15. End Of test 

* . ■ < 

' ■ ' ■ y = ■ . ■ ' 




Testing Student and Giving 

f » 

Feedback to Student and Proctor 
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Key to Flowchart 

Giving Information to Proctor when Student Completes an Instructional S ession^ 

' 1. Sign on ' 

2. Initialization of coi^nters to be used for recording of-number of 

\ questions answered, number answered correctly on the first attempt, 
number of time-outs, etc. 

3. * Body of 1 ns tructl^ which uses the specified counters to record 

Information 

4. Question Is presented and student has. chance to respond 

5. Did studer^^ Indicate that he wants to sign off Instead of responding 
to question? 

6. Sending of messages to proctor consisting of Information on the 
' student's performance during the recent session i . 

7. End of session; when student signs on again he'wlll be restarted at 
beginning of the section In which he signed off 

8. Analysis of response and continuation of Instruction 




- 

/ ■' 



ft 

From Penn State's course segments AToebra and General Math , U. S. Office of 
Education through the School District of Pittsburgh, prime contract Grant Nov 
OEG-0-8-055230-3479, Project No. 5523, IBM 1500 system; authors: Carol Dwyer, 
Robert I go, Terry Bahn, Diana Ryall . 
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Giving Information to Proctor when 
Student Completes an instructional Session 
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Fig. 20. Giving, Information to proctor when\ student completes an Instruc- 
tional session. 
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If while remaining In the basic framework planned by the author, the 

V 

student can control course flow, performance of the student may be Improved; 
and. In addition, , when the Instructor reviews the flow through the course 
selected by the student, he may receive cjues as to where revisions are needed! 
Computer-assisted Instruction can provide great opportunity for student-control 
of course flow. At each question, prior to answer analysis, tests may be made 
for a special code which. If typed by the student. Indicates a request for 
one of the optTons available In the course that will alter course flow (see 
Figure 21) . 

Sequence based on number of consecutive problems which are correct . A 
student who has mastered a concept will lose Interest If he Is required to 
answer question after question using this concept. In a set of practice 
exercises, flexibnity can result b^. having many exercises available and 
branching out of the sequence of exercises 1f the student answers correctly a 
specific number of consecutive problems (see Figure 22). 

Allowing student to change responses . The student 1s given four problems 
to solve. He answers each one individually In order, with his answer being 
placed next to the corresponding question. After the responses have been 
given, but before feedback as to correctness Is made, the student Is given 
the option to change any of his answers. After any desired changes are made, 
analysis Is done and feedback Is given on all problems (see Flgiire 23). 
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Question-Level Flowcharts 

' V ’ • 

-Question-level flowcharts Involve the strategy required for a single’ 
question, problem, or frame. The strategies presented hehe are merely a 
representative sample of possible sequences at the question or frame level. 

Individualization of Presentation 

One criticism of computer-assisted Instruction Is that .receiving Instruc- 
tion via a machine Is too Impersonal . However, there are means by which an 
author can decrease the feeling of the student that he Is alone with a powerful 
mechanical device. 

: ' ' % , V . 
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Key to Flowchart ■■ Student Control of Course Flow ■( 

1. Start of lesson 

2. Series of problems 

.3.- Problem Immediately preceding the current problem 

4. Preliminary instructions .for the current problem are presented 

5. The problem Is presented 

‘6.. Student may respond to the question 

•7. Was an unavailable ^option r^uested? 

8. Message that the selected option Is not available at this time 

9. Was a. request for help . from' the proctor made by the student? that 

Is, did the student type "-h"? ‘ | . . 

10. Proctor me'ssage Is sent to' the proctor: station and the student Is 
told to wait for assistance, ' 

11. Did the student request. a review of the lesson? that Is, did the 

student type "-r"? ' ^ 

12. Revifew questions and discussion of the material covered’ thus far In 
the current le.sson and pertinent Information from previous lessons 

13. Did the student request a summary of the current lesson? that Is, 
did the student type "-s"? 

14. Presentation of summary statements of Information presented In the 
current lesson 

15. Did the student request to go back tb the beginning of the 
current. problem? lJiat Is, did the student type "-p"? 

16. Did the student request to go back to the previous problem? 
that Is, did the student type "-b"? 

17. Did the student request to go back to the beginning of the 
current lesson? that Is, did the student type "-I"? 

18. 1)1d the student request to go to the end of the current lesson? 
that Is, did the student type "-e"? 

19. Did the student request to go to the next problem In sequence? 
that Is, did the student type "-n"? 

r 

20. Did the student type the correct answer to the question? 

21 . Feedback for correct response 
^ 22. Next problem In sequence 

23. Additional answer analysis Instructions' 

24. End of the current lesson . 



student Control of Course Flow 




Key to Flowchart 

Sequence Based on Number of Consecutive Problems which are Correct 
/I. Start 

2. Initialize specific counters for scorekeeping and give Instructions 

3. Question Is presented and student responds 

* r ^ • - 1 

4. Is the answer correct? If yes, gd to &; If not, go to T2 

5. Give feedback that response Is correct; add 1 to the total -correct 

counter; add 1 to":the counter storing the number of consecutive 
correct problems . , ' ' 

' j ■ . . , , \ ' . ■ ' 

/ 6. Has criterion of getting a certain number of consecutive problems 

correct been met? If yes, go to 7; otherwise, go to 8 

7. Indicate that, criterion has been met and go on tp next section 

8. Have all learning exercises been presented? 

9. Did the. student have 60% of all problems correct? 

1^. Present several practice problems with specific feedback when 

^ Incorrect 

' , 11 . (j Give intensive remedial Instruction and practice exercises 

12. Indicate to the student that response. 1s incprre1:t and give specific 

feedback to assist the studefnt In understanding how to correctly * 
answer the problem ” 

13. Initialize to zero the counter In whl^ch the number; of consecutive 
correct problems is stored 
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Sequence Bas6d on Number of 
Consecutive Probi ems which are Correct 






Fig. 22. Sequence based, on number of .consecutive problems which are 
correct. • ’ 
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Key to Flowchart - A1 1 owl ng Student to Change Responses' 



1 . 

2 . 



3. 

4. 

C 

s: 



6 . 



7. 



8 . 



9. 



10 . 

11 . 



Four problems are presented 



Student Is allowed to respond to one of the questions; response Is 
placed below the question 



The response and whether It Is correct. 1s recorded ^ 

Have all questions been answered? If so, go to 5; if not go to 2 

Student Is asked whether or not he would, like to change any answers; 
if so, go to 6, if not, go^ to 10 

Student Is given the opportunity to list the numbers of the problems 
he, would like to change 

Has the student been given the opportunity to change all prob,lemS' 
that he wanted to change? If yes, "go to 10; If no go to 8 

Has student Indicated that he would like to change problem n? If 
yes, go to 9; if no go to 7 

*> ' ■ 

Student responds again to problem n; his answer and whether or not it 
is correct Is recprded In place of. the former results 

Student Is told which answers are correct and which are Incorrect 

Next problem . 



/ 



^From Penn State's course segment Algebra, U. S. Office of Education through 
the School District of Pittsburgh, prime contract Grant No. OEG-0-8-055230-3479, 



Project No. 5523, IBM 1500 system; authors: Catherine Folger and John McNear. 
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Allowing Student to Change Responses 




Fig. 23. Allowing student to change responses. 
^ ■ ■ . 
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Introduction of new concept .. Assume, that a new concept is to be intro- 
duced. Since the purpose of the question 'to be asked is to provide a provoca- 
tive introduction or bridge to what comes next, the student's response should 
not be checked for correctness. However^, when the student has completed his 
response, he is presented wi th some correct answers before continuing. 

Flow proceeds directly in order: 

1 . Display question: What is a noun? 

2. Student is allowed to respond 

'3. Feedback is presented to the student that begins, "You should have 
typed. . . 

4. The student indicates when he is ready to go on 

Personalizing a course by using student's name . It is possible to make 

the student feel that the course has been individualizecHay using his name in 

asking questions ‘ahd-in giving him feedback. This can'oe done easily by asking 

the student to type his first name at the beginning of the course or by 

retrieval '^of the student's name from his record. 

Flow proceeds i>i ordeir: 

1. The student is asked a question 

2. The student responds 

3. Appropriate feedback and the student's "^ame are displayed 
Displaying student's response . It may b§ desirable to display the response 

made by the student. Any response the student makes is saved until the next 
response request. Therefore, all that is necessary is for the response to be 
displayed in an appropriate place. • 

Procedure could be: 

Display the phrase, "l^ou responded" followed by the student's response 

and the question, "Is this what you meant to say?" 

' . ' , 

Requests Made by Student 

Students participating in computer-assisted instruction are usually accus- 
tomed to conventional classroom instruction in which many of their questions 
are answered and individual problems may J>e solved with a brief request. With 
CAI , students may have the option to request individual assistance from a 
teacher and also to make other requests. 
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student may request assistance- from proctor . SitulPtlons may arise in . 
which the student reaches an impasse in the course. One way this could happen 
is within a question frarne that requibed the student to give a correct answ^ 
before he goes on ‘to the next frame, but the student cannot determine the cot^ 
rect answer from the hints given. The student cannot go^on without help, and 
if the hel D^.rec’iired is not programed into the course he can enter a request 
fpr help from the proctor who could then give him individual assistance (see 
Figure 24) . . 

Student may request correct answer . The author allows the student to 
request the correct answer to a question by entering the word "go." Once he . 
has been given the correct answer, he must type it before he can proceed to 
the next material, if the response "go" is not found, the student's response 
is compared in the usual manner wi th’ anticipated correct and incorrect answers, 
and feedback is, given (see Figure 25). 

Student may indicate need for review . The student may be told before 
beginning a series of questions that if he feels a need for a review, such a 
request may be made by typing the word "review" at the time of a response 
request instead of entering a response. One of the anticipated responses for 
each question would be "review" which j if matched, would be followed by a 
branch to an appropriate review sequence (see Figure 26). ^ 



Flexible Feedback 

Since computers have the capability to use information about the student, 
varied feedback can be stored in the program, and its use can depend on the 
student's personality, background, or performance. 

Feedback adjusted to student . Students with many personalities and past 
achievement and differing in sensitivity and temperament take courses presented 
by computer-assisted instruction. In a course with one path that all students 
follow, it is possible to make feedback appropriate to the student. Several 
types of feedback may be available throughout all of the course or within 
specific sections such as a review prior to a quiz. As examples, here are 
three types: 
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Key ^ Flowchart - Student May Request Assistance From the Proctor 

The student may be^ given the option to Interrupt the flow of.the counse at 
any. time to request assistance. The dotted lines Indicate student-1 nttlated 
flow. 



1 . 

2 . 

3. 

4 . 

5. 

6 . 

7. 

8. 
9. 

10 . 

11 . 






Start of problem 

Question Is presented • , “ 

Student 1s given opportunity to respond 
Was answer correct? 

Appropriate feedback Is given and student goes to next problem 
Was this the first Incorrec^response? 

First hint 

Was this the second Incorrect response? 

Second hlpt . . ^ 

Third hint, which Is given on, all subsequent responses ' 

Proctor message Is sent by the student that he needs help; assistance 
Is given by the prop tor either on or off line; when the student Is 
ready to continue, the computer automatically branches to the begin- 
ning of the current problem 
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student May Request Assistance 
From the Proctor 
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Note: Dotted lines Indicate points where assistance may be requested, 

^ % 

Fig. 24. Student may request assistance from the proQtor. 
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Key to Flowchart - Student May Request Correct Answer^ ^ 

1. Entry to problem 

2. Problem Is presented 

3. Question is asked 

"4. Is response "go?" ' 

v5. Correct response is given and student is told to type response 

6. Additional response analysis takes place 

7. Continuation of course 

' V 




s 



^^From Penn State's course segment Atomic Energy t Project No. 5-85-074 
IBM 7010 or 1410; author; David Gilman. 



170 






163 

Student May Request Correct Answer 

\ . 



\ 




Fig. 25. Student may request correct answer 
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Key to Flowchart - Student May Indicate Need for Revi ew 

1. Question is presented 

2. Student responds to question 

3. Did the student match the correct answer? 

' 4. Did the student match a specific wrong answer? 

5. Specific feedback is given 

6. Did the student type the word "review"? 

7. Review 

8. Feedback given for an unrecognized response 

9. Feedback for correct response 

10. Next problem 
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student May Indicate Need for Review - 




F1g. 26. Student may indicate need for review. ‘ 
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1 . 



2 . 



3. 



For the "well-adjusted h1gh-ach1ever," feedback would be 
short and could Include some information about the gap 
between the student's ability and his performance. 

The "non-extreme personal 1 ty and/or average-achiever" would 
receive the common type feedback. 

For the' "unconfident low-achiever," feedback would be encouraging 
and extensive. 






When the decision relative to the type of feedback applicable Is made, 
a counter can be loaded with one, two, or three corresponding to the type of 
feedback. Jhls . counter can be lsfi*ecked at the appropriate points In the course 
to determine wh1.ch of the three av^illable feedbacks Is to be used (see 
•Figure 27). . ^ ^ 

Varying feedback for each response attempc . Common^ programing usually 
provides varying feedback for several anticipated responses. However, many 
progr^mers do not provide different feedback, for example. If the correct 
answer is given pn the second, third, or fourth attempt as opposed to the 

\ 

first attemptv Feedback of "excellent" on the fourth response to a basic 
question, may make a student lose confidence In the course program. If 
desirable. It Is^lthln the capabilities of CAI to program varying feedback to 
be used response attempts. In the example Included here, the 
flow far aTmatch or the correct answer Is shown. The same logic could be 
followW^r each anticipated incorrect response (see Figure 28). 

Multiple-level q'uestion . "Behind the scenes" In a question from the main 
flow of a course, there may be a great deal of course material which Is not 
presented to the student) who quickly comprehends, the objective of the particular 

'Si* 

lesson; this student answers the question correctly and Immediately goes to 
the next problem, in the main flow. However, as In this example, for each of 
the three Incorrect choices 1n the multiple-choice question from the main flow, 
different feedback Is given and a thought-provoking question Is asked. Then, 
depending upon the response to this question, a review may be given, an addi- 
tional question mayi be presented, or some resulting conclusion Is stated fol- 
lowed by transfer back, to the original main flow question. If the student 
answers the main flow question Incorrectly on his second' attempt, he Is given 
a review. * ' 
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Key to Flowchart - Feedback Adjusted to Student 

1 . Start 

2. Setting of counter n to one, two, or three corresponding, to feedback 

type on the basis of some judgment as to the student's personal 1 ty 
or achievement ‘ . * • 

' * ► "j 

,3. Presentation of a question; student responds 

4. Was response correct? ' , 

5. Should feedback 1, telling the student he Is coVrect, be given; that 
‘ Is, Is counter n equal to one? 

6. Feedback 1, telling the student he Is correct. Is given ^ 

7. Should feedback 2, telling the student he Is correct, be given; that 
Is, Is counter n equal to two? 

8^ Feedback 2, telling the student he Is correct. Is given 

9. Feedback 3, telling the student he Is correct. Is given, 

10. --Should feedback 1, telling the student he Is Incorrect, be given; that 

Is, Is counter n equal to .one? 

11. Feedback 1, telling the student he Is Incorrect, Is'^ given '/ 

,12. Should feedback 2, telling the student he Is Incorrect, be given? 

13. Feedback 2, telling the student he Is Incorrect, Is given :'>■ 

14. Feedback 3, telling the student he Is Incorrect, Is given 

15'. Next problem 1n sequence 
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Feedback Adjusted to Student 




r\ 



Fig. 27. Feedback adjusted to student. 
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Key to Flowchart - Varyi ng Feedback for Each Response Attempt 

1. Start and Initialization of the counter used to record number of 
response attempts to this problem (counter (n) 

Question Is presented and student responds 
Counter n Is Incremented by one 

Did student give the correct answer? ^ ' 

Additional answer analysis Instructions and appropriate T^dback 
Does counter n contain I? . . \ 



. ^ 
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2 . 

3., 

4. 

5. 

6 . 

7. 

8. 

9. 

10 , 

11 . 

12 . 



Feedback 1, for response correct on first attempt, Is given 
Does counter neon tain 2? 

Feedback 2, for response correct on second attempt, Is given 
Does counter n contain 3? ^ 

Feedback 3, for response correct on third attempt. Is given 
Feedback 4, for response correct on fourth or later attempts, is given 



.13. 'Next problem 
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Varying Feedback for 
Each Response Attempt 
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Fig. 28. Varying feedback for each response attempt. 
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The main flow question used In this flowchart appeared In a programed 
textbook by Helmer and others (1963). 

At any time during the multiple-level question, If the student does not 
select from the stated choices, he Is branched to a special routine to Inform 
him of this condition and Is given a chance to respond to the question again. 
Also, after each special review, a branch Is made back to the original 
question (see Figure 29). 

Editing Student's Response 

It would be unreasonable to assume that each student will type the 
correct answer In one definite sequence of characters. Since the computer 
records by characters,. It may be necessary. In order to eliminate a possible 
source of confusion, to delete Irrelevant characters from a student's response 
prior to analyjflr^ whether It Is correct. Several examples of what can be 
done In computer-assisted Instruction are as follows: 

1. replace commas and periods with a space or delete 
specific fliinctuatlon marks 

2. compress all spaces from the student's response 

3. compress multiple spaces Into one space 

4.. replace capital letters with lower case 

5. replace an 1 (el) with a l (one) 

In addition, words can be replaced with synonyms. 

Downshifting response characters and replacing words w1 th numbers . The 
author specifies that the quantities 12 and 3 appear In the student's answer 
In that orjler for the answer to be accepted as correct, but' he wishes to allow 
the student to Input these quantities as words, with or without capital letters 
or as numerals. • He accomplishes this by editing the response In a manner to 
delete any shift characters from the student's response and to replace "twelve" 
with "12" and "three" with "3," and then testing the student's answer for the 
presence of 12 arid 3 In order (see Figure 30). 

Replacing words In student's response w1 th synonym . Often a word 1 n a 
student's response Is acceptable as correct even though misspelled. The 
example which follows Illustrates one way that -the student's response may be 
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Key to Flowchart - Mu1t1p1e-Level\ Question^ ^ 

I. Display question: 

When we write /x-2, It Is understood that x-2 p, 

a. ^ b. ^ c. = d. < 

'2. Did student select b? If so, go to 3; otherwise, go to 5 

3. Give feedback: You are correct , ^ 

4. Next problem ' ’ 

5. Has student answered the question from the main flow (Item 1) Incor- 
rectly twice? If so, go to 6; otherwise go to 8 

6. Give feedback that student has answered Incorrectly once again and 
branch to a special review 

7. Special review on why Implies that x-2 ^0 

8. Did student select a? If so, go to 9; otherwise, go to 10 

9. Give feedback: Your answer Is -parti ally correct, x-2 Is defined 

when x-2 > o. Is vCT. defined when x-2 = 0? ‘ (Answer yes or no.) 

Go to 27 

10. Did student select c? If so, go to 11; otherwise, go to 12 

II. Give feedb ack: Your answer Is partially correct. Is defined 

when /x-2 * 0, Is ^ defined when x-2 > 0?, (Answer yes or no.) 

Go to 33. - ; 

12. Since the student gave d as his choice, he Is asked: Is defined 

when x-2 = 0? (Answer yes or no.) 

13. Did student answer yes? If so, go to 14; otherwise, go to 15 

14. Feedback that student Is correct Is given., Go to 16 

15. Has student answered the question In Item 12 Incorrectly twice? If 
so, qo to 7; otherwise, go to 29 

16. Student Is asked: Is /iTT defined when x-2 > 0? (Answer yes or no.) 

17. Did student answer yes? If so, go to 18; otherwise, go to 19 

18. Feedback Is given that student Is correct. Go to 25 

19. Has student had a prior opportunity to answer the question In Item 16? 
If so, go to 20; o.therwise, go to 21 

20. Special review on why Is defined when*y >0 

21. Student Is told that he is Incorrect and Is given the additional 

feedback; ^ - 

Recall that when we write' It Is understood that y > 0. 

If y * x-2, then by our* agreement. If we write then 

x-2 * 0 or x-2 0. 

. a. < b. ■ c. > d. none of these 

22. Did the student answer c? If so,, go to 23; otherwise, go to 26 
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23. 

24. 

25. 

26. 

27. 

28. 
29. 



30. 

31. 



32. 



33. 

34. 

35. 



Feedback 1s given: Correct. »^x-2 Is defined for x-2 >0. Go to 24 

Did student come to the question In Item 21 from a wrong answer to 

Item 16? If so. go to 16; otherwise, go to 25 

Additional feedback Is given: Thus, Is defined when x-2 Is 

non-negative. Now try again to answer the original question (Item 1) 

Feedback Is given: No. The correct answer Is > . If we write 

r ^ s. wp mean r > s or r ■ s. Go to 24 ^ 

Did student select yes? If so. go to 28; otherwise, go to 29 

Feedback, "Right," Is displayed. Go to 25 , 

Feedback Is displayed: Incorrect. Recall that when we write It 

Is understood that y ^0. If x-2 * 0, then x-2 » ^ and »^ » ? 

a. 0 b. 1 c. 2 d. none of these 

Did student answer a? If so, go to 31; otherwise, go to 35 

Feedback 1y given: Correct. Thus, /x-2 Is Refined when x-2 Is 

non-negatlye. Now try again to answer the questibn. Flow goes to 
Item 32 / 

Did the'stu^^ome to this question after answering the original 
question witirlwie Incorrect choice d? If so, go to 12; otherwise, 
go to 1 ^ , 

Did student answer yes? If so, go to 34; otherwise,, go to 21 

Feedback Is given that student's, response Is correct. Go to 25 

Feedback Is given: No. 0 so /x-2 « 0. Thus, A- 2 Is defined 

when x-2 * 0. Go to 32 



"IT 






^Vrom Penn State's course segment Demonstration In Mathematics , for 
National Conference on Computer-Assisted Instruction, The Pennsylvania State 
University, University Park, Pa., September 24-26, 1968; IBM 1500; authors: 
Ralph Helmer, Paul Klein, Robert Hostetler, Carol Dwyer. 
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Key to Fl awchart 

Downshifting Response Characters and Replacing Words w1 th Numbers .. 

1 . Start ' 

2. Display question: In our system of measurement, we use the foot and 

the yard, there are ^ inches In 1 foot and feet In 

/ ' 1 yard • ^ 

I 

3'. Student responds to question 

• 4. Response Is edited with functions. That is, upper case betters are 

replaced with lower case; "12" replaces "twelve;" "3" replaces "three" 

o * 

5. The integer which appears first in the response is placed in counter a; 
the Integer which apiiears second is placed in counter b . 

6. Does counter a contain 12? if yes, go to 7; if no, go to 9 

7. Does counter b contlain 3? if yes, go to 8; If no, go to 9 
8^ Feedback th^ answer is correct 

9. Feedback given because of incorrect answer: There are 12 Inches In 

» 



1 foot and 3 feet in one yard 




Downshifting Response Characters 
and Replacing Words with Numbers 
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edited so that a specific word In his response Is changed to the most acceptable 
version of the word (antlhellx), and then his response Is tested for^the pre- 
sence of three words (lower, crus, antlhellx) in order as separate words 
(see Figure 31 ) . 

Responses Checked for Key Parts 

When one thinks of the number of possible combinations that a stgdent 
could type a set of three correct words, he realizes that It would be quite a 
task If In each multiple-word response the various versions of the correct 
answer had to be IlstedI In CAI, functions can be used to scan the student's 
response for the words of the correct answer, evaluate the number correct, and 
Inform the student which Items are correct. 

Testing for specific words In student's response . Since many varieties 
of both correct and Incorrect responses can be made by students. It Is often 
desirable to check for specific "key" words In the response and give feedback 
based on the number of words which matched the correct response. In ^1s 
example. If at least six of the seven words are matched, the student Is told 
he Is correct and Is branched to the next problem. If from one to five words 
are matched, the student Is Informed as to which words he had correct. If no 
words were matched, the student would be branched to a review section (see 
Figure 32). 

Checki ng response for specific character strings . > This section describes 
a routine which Is designed to test a student's response for specific charac- 
ter strings (partial words), as opposed to complete key words. If any of the 
strings are found, the student's correct words (I.e., those words containing 
acceptable strings of letters) are fed bacjc to the student (see Figure 33). 

Multiple-Part Responses 

A question often askec' about CAI Is whether or not the system can handle 
responses consisting of several parts such as sentences or mathematical 
equations. The answer Is afflmatlve, and with the capability to write new 
functions and add tfiem to the system, the possibilities are almost limitless. 
Student-constructed equations and complex numbers can be analyzed for 
correctness. 
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Key to Flowchart - Replacing Words 1n Staident*s Response with Synonym 

In this example, the student Is asked to Identify a portion of the pinna 
marked on a plaster model of the hunan ear. 

1 . Start 

2. Question Is presented: "What Is the name of part C?” Student Is 
given opportunity to respond 

3. Editing Is done to change a word In the student's response to the 
most acceptable version, I.e., anthellx, anti helix, anti-helix, 
anti -helix, anti- helix, and anti - helix are edited to antihellx 

4. The correct response, lower crus antihellx. Is compared with the 
student's response. A test Is made to determine whether three words 
In the student's response Were correct. Here three words correct? 

5. Feedback for correct response Is displayed: Your answer Is correct 
. 6. Next problem 

7. A test Is made to determine whether one or more words In the student's 
response were correct. Were one or more words correct? 

8. Feedback for partially correct respon.se Is displayed: Your answer Is 
partially correct. Try again 

9. Feedback for totally unrecognizable response Is given: Your answer Is 
Incorrect. Find the correct answer on your. handout and type It. 



12 

From Penn State's course segment Audiology , Project No. 5-1194 
IBM 7010 or 1410; authors: Bruce M. Slegen thaler and Jeffrey Katzer. 
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Response with Synonym ' ( 
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Fig. 31. Replacing words in student's response with synonym. 
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1. start 

2. Problem Is presented: Name six of the seven colors of the spectrum. 

3. The response Is checked for correct words (red, orange, yellow, green, 
blue. Indigo, violet). Is the number of matched words equal to or 



4. Feedback for correct answe.' Is given: You have the answer entirely 
correct. Very Qood. 

5. Next problem . ' 

6. Is the number of matched words greater than or equal to 1? 

7. The correct words from student's response are shown to him 

8. Feedback for partially correct response Is given: The^ list above 
Indicates whlch-^colors you. have correct. Give another answer Including 
these you now have correct 

9. Unrecognized response noted 

10. Feedback for answer with no correct words given: You aren't doing 
' very well. It appears you need a review. 

11. Review of concepts from which branch will be made back to current 



greater than 6? 
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Testing for Specific Words 
j[n Student's Response 




Fig. 32. Testing for specific woHs In student's response. 
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Key to Flowchart - Checking Response for Specific CharacteV Strings 

1 . Start 

2. Display question: What are the three fundamental particles In an 
atom? 

3. Student responds to the question 

4. Test for key strings (I.e., "prot,” "neut,” "elect") to see how many 
match the correct' strings; If all are found, go to 5; If one or more 
are found, go to 7; and If none are found go to 9 

5. Display feedback for correct response 
\ 6. Next section of course 

/V Edit student's response so that only the words containing correct 
'strings appear 

8. Display the edited response to Indicate to the student which words 
were correct and give the message that the answer Is partially correct 
and the student Is to try again; go to 3 

9. Indicate the answer Is completely wrong and go to 3 
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Checking Responses for 
Specific Character Strings 




Fig. 33. Checking responses for specific character strings. 
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Creating a response by selecting its parts . A creative approach from the 
student's viewpoint can be used in the construction of mathematical open 
sentences (i.e., equations with unknown quantities). Given the mathematical 
characters □. 3, and 4. the student is asked to construct an open sen- 

tence using each of the items once. As an item is selected, it is excluded 
from the list so that it may not be used again, thus limiting the number of 
possible correct solutions. 

On the first incorrect response, the student is told that the items do 
not form an open sentence. On subsequent incorrect responses, he is given a 
list of correct responses, is asked to construct one of these, and ask the 
proctor for help if needed (see Figure 34). 

Two-part response by student . Often a response includes two parts, each 
of which should receive specific feedback. In this example each part of the 
response consists of one word, either oxygen, or hydrogen. Feedback is given 
indicating which of the wofds are correct.. If the ito^ent does not answer the 
question correctly by the third attempt, he is branched to a review (I.iterna- 
tional Business Machines Corporation^ 1968, pp. 43-44, 52), (see Figure 35). 

7 

Responses Requiring Ordering ^ 

Many questions asked by instructors require more than one word in the 
response. In addition, in the correct response these words must be in a 
definite order. CAI has the capability to analyze responses containing several 
words, letters, numbers.^ or strings of characters. These key parts may be 
checked for order, position, and initial ^woi^s or characters. 

Arrangement ^ student of given items iji .proper order . The problem for 
the student in this exercise is to arrange five particles (proton, neutron, 
electron, atom, and molecule) according to weight and for him to type only the 
initial letters in the proper order. The author wants the student to be ab]e 
to enter the letters freely, in upper or lower case and with any reasonable 
combination of punctuation and spaces between the lettei^. Al'so, since he - 
lists the particles, the author anticipates that a student may list the letters, 
i.e., separate them with carriage returns. Therefore, the author begins .by 
deleting shift-characters, spaces, periods, commas, semi -coins, coins, dashes, 
and carriage returns from the student's response. He theri tests for the 




194 



4 



^ . 1.95 



9 



Key to Flowchart - Creating a. Response by 



Selecting Its Parts 



1 . Start 

2. Display the basic set of symbols: □, *, +, 3, 4 

3. Give Instructions for the problem 

4. Student resppnds by Indicating the order of his choices from the 
given Items 

5. 'Is the student's response a valid open sentence construction? If not, 
go to 8; otherwise, go to 6 

6. Give feedback that response was correct and go to 7 

7. Next phase of Instruction , 

8. Is this the student's first mistake? If so, go to 9; otherwise go 

to 1.0 y 

9. Feedback: The Items do not form an open sentence In the order chosen. 

Answer again. , . ' 

10. Display all possible valid constructions of open sentences using the 
given elements; ask the student to type one ^f these and to request 
help from the proctor If assistance Is needed 





^^From Penn State's course segment General Mathematics, U. S. Office of 
Education through the School District of' Pittsburgh, prime contract Grant No. 
OEG-D-8-055230-3479, Project No. 5523, IBM 1500 System; authors: Roland Lazzaro 

John McNear. 
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Key to. F lowchart - Two-Part Response by Student 

1. Question is presented: What are the two elements of water? 

2. Student is allowed to respond two separate words 

3. Increment counter keeping track of number of responses to this 
question; initialize counter keeping track of which words are 

given correctly «■ 

4. Does student's response include the word "oxygen?" 

5. Indicate to the student that "oxygen" is correct 

6. .increment by 2 the counter keeping track of which words appeared 

in the response 

7. Does the student's response include the word "hydrogen?" 

8. Indicate to student that "hydrogen" is correct 

9. Increment by 1 the counter keeping track of which words appeared 

in the response 

10. Does the counter keeping track of which words appeared in the student s 
response contain 3? 

11. Next' problem 

12. Has student made three attempts to answer the question? 

13. Tell the student that the correct response is oxygen and hydrogen and 
indicate to the student that he will receive a review 

14. Review from which student wi],l be branched to the beginning of the 

question set 

15. Give him feedback that the response is incorrect; ask him to answer 
again, giving both elements correctly 
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T wo-Part Response ^ Student 
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F1g. 35. Two-part response by s^dent. 
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correct answer: manpc . If this fails, the author tests for the presence o. 

any 'of the other 21 letters of the alphabet and the numbers 1, 2, 3, 4, 5. If 
one or more extraneous letters or numbers are found, the student is told to 

type only the initial letters and to answer again. 

At this point in the processing, if one of the letters manpe is found, it 
is not because the student entered a word such as "neutron." The author there- 
fore tests for the presence of at least one of the letters. If at least one is 
found, the student gets a feedback which types the letter(s) he had in the 
correct order and types dashes for the letter(s) which he omitted or had out of 
order. Fqr example, if the student's answer is mpnea, the feedback, is: ma—. 

If the'student ' s answer does not contain at least one of the five letters, 
he receives feedback designed for, an unrecognizable response (see Figure 36). 

Analyzing a response containing ordered words . Many times ? significant 
part of the response is the order in which the words of the response are given. 
An example would be a request to identify the four seasons of the year begin- 
ning with the season of the month of January. 

In this example, for the student's answer "fall winter spring summer," 
feedback would be given in the form "winter spring summer " with the state- 

ment that the dashes indicate an omission or improper order of the season. 

In order to eliminate the resulting confusion if the word autumr) would be 
used in place of fall, prior to checking the response, "autumn" would be 
edited to "fall" (see Figure 37). 

\ 

Numerical Responses 

Many types of numerical responses may be analyzed in a CAI system. 
Responses may be checked precisely or to determine whether they fall into a 
specified range. Several nlimbers may be checked simultaneously; the numerator 
and denominatoi* of fractions may be checked individually. - 

Testing for ^ numerical response within a specified ran^e. An author may 
want to accept any response in which the integer portion. of the number in a 
response is correct, regardless of the yalue of the decimal places or the 
nature of the text typed along with the number. 
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Key to Flowchart - Arrangement by Student of Given I tems 1_n Proper Order 



14 



3. 

4, 



5. 



6 . 

7. 

8 . 

9. 



10 . 

11 . 



12 , 

E3. 

14. 



15. 

16. 
17 



18. 

19. 



20 . 



Start; Initialize to zero the counter In which number of responses 
Is kept 

Show the proper Image on the image pro’ cor and display the statement: 
The proton is much heavier than the electron. The neutron Is about the 
size of the proton and electron combined. Arrange the particles ac- 
cording to weight from the largest to the smallest. Type only the 
first Tetter of each word. 

Display the list: proton, neutron, electron, atom, molecule 

Student is given time to type his response 
Punctuation and spaces are edited from student's response 

Is student's response "manape?" \ 

Give feedback: Correct: molecule, atom, neutron, proton, electron 

Next problem 



Increment by 1 the counter in which number of responses to the question 
is recorded 



Has student responded more than four times? 



Give proctor message asking proctor to assist student or give a 
review 



Does student's. response contain extraneous letters or numbers? 
Display: Type only the initial letter of each particle (in order) 

Is .at least one of the letters in the student 's response in the 
correct order? 

. Give feedback indicating which letters were placed in proper order 
Is this the first unrecognized response? 

Display: Reread the paragraph above and consider the relative weight 

of each particle. Then type the Initial letter of each particle from 
the largest to smallest 

Is this the- second unrecognized response? 

Feedback: The, molecule is. the largest. An m should be your first 

letter. Try again. 

For all additional unrecognized -responses feedback is as follows: 

Hint — Each atom is composed at- least of one electron, proton, and 
neutron. Answer once again. 



14, 



^From Penn State's course segment Atomic Energy . Project No. 5-85-074 
IBM 7010 or 1410; author: David Gilman. 
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Arrangement by Student of 
Given Items in Proper Order 

© 







Fig. 36. Arrangement by student of given Items In proper order. 
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^ Flowchart - Analyzing a Response Containing Ordere d^ Wor^ 

1 . Start 

2. Presentation of question: What are the four seasons of the year, 

starting with the season in which January is? 

3. Student responds 

4. Any appearance of "autumn" in the student's response is edited to 
"fall." 

5. Does the response contain "winter spring summer fall" in proper order? 

6. Give feedback that the response is correct and all seasons are in the 

proper order 

7. Next problem 

8. Does the student's response contain at least one correct word? 

9. Give feedback as to which words are in the proper order and ask the 

student to answer again 

10. Has the student responded with an unrecognizable response two times? 

11. Remedial instruction on the seasons of the year 

12. Give feedback that the response is totally incorrect and the student 
should try once more to answer the question correctly 
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Analyzing a Response 
Containing Ordered Words 




Fig. 37. Analyzing a response containing ordered words. 
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I Proper coding' makes it possible to pick a numerical field from a response, 

‘ convert it' to an integer, and store it in a specific counter. The contents of 

j the counter are then compared with the correct response to test whether the 

^ student's response was acceptable. 

In the example below, the integer is extracted from the response. If the 
I response is exactly correct (5.3), the student will see the correct answer 

feedback. If the student is almost correct (5.0 to 5.9), he is told the cor- 
I rect response and continues on. If his response does not include the correct 

integer portion, he is branched to a review (see Figure 38). 
j Testing for a precise numerical response . Let us assume in this example 

that the desired numerical response must be precise to nearest tenth. The 
j student is allowed to respond any number of times and at each response he is 

’ told whether his numerical response is too high or too low, and as the range 

of his response from the precise response is decreased, the feedback gives 
! some encouragement such as "You are very close." (see Figure 39). 
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Key ^ Flowchart - Testing for a_ Numerical Response within a Specified Ran^^ 



T. Start of problem 

2. Problem Is presented: Measure line a on the handout. Give your 

answer in centimeters 

3. Student is given a chance to respond 

4. Did response match correct answer: 5.3? 

5. Feedback for correct answer: Correct 

6. The integer, portion of the first numerical field is picked out from 
the response and placed in a counter 

7. Does the counter contain 5? 

8. Feedback tor answer within acceptable range: Correct. The answer 

is 5.3 and you are close enough to it 

9. Feedback for unacceptable answer Is displayed. No, there are 5 whole 
centimeters plus 3 tenths of a centimeter. Let’s try a review 

10. Pause so that student can measure line a_ again 

11. Special review on measurement in the metric system 

12. Next problem 



J ' 
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course segment Metric System of Measurement . 
Project No. 5-85-074, IBM 70),0 or 1419; author: DavTd Gilman. 
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Testing for ^ Numerical Response 
within a Specified (Range 




Fig.. 38. Testing for a numerical response within a specified range. 
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Key to Flowchart - Testing for ^ Precise Numerical Response 

Assume that the desired response is 23.7 or between 23/69 and 23.71. 

1. Question is presented 

2<. Student responds ' 

3. Is response between 23.69 and 23.71? 

4. Give feedback that response is correct and go to 5 

5. Next question 

6. Is response between 23.6 and 23.8? 

7. Give fee*dback that student's response is "Extremely close but" and go 
to 12 

8. Is response between 23.0 and 24.0? 

9. Give feedlqpck that student's response is "Very close but" and go to 12 

10. Is response between 20.0 and 30.0? 

11. Give feedback that student's response is "Quite close but" and go to 12 

12. - Is response less than or equal to 23.69? 

, 13. Give feedback "response is too low." 

i 14. Is response greater than or equal to 23.71? 

15. Give feedback "response is too high." » 

j 16. r If student reaches this point, he has not typed a number so he is 

told to type a number 

I 
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Testing for ^ Precise 
Numerical Response 




Fig. 39. Testing for a precise numerical response. 
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CHAPTER VIII 
DISSEMINATION 

Dissemination activities of the CAI Laboratory have been extensive and 
have varied'in form. Fellowships and graduate assistantships have been but ^ 
one phase of what we see as an ongoing process of training others in the poten- 
tial of computer assisted instruction in education. New methodologies., new 
curricula and new educational strategies ,do’ not happen. Innovations must 
be developed and communicated through assmany avenues ''a^^pbssible in order to 
overcome the great inertia in educational processes. Individuals trained in 
computer-assisted instruction can influence the course of educational change.. 

Information about our CAI activities in technical education have* been, 
disseminated through demonstrations to individuals from the United States 
and representatives from foreign countries. Graduate^-and undergraduate classes 
have toured the Laboratory facilities and have learned about the potentials of 
CAI in the coming years. Samples of this .information for selected periods is 

summarized in the tables that follow. ' 

The reports, journal articles, and speeches dealing with the CAI Labora- 
tory are given in the sections that follow. Again it is easily seen that these 
formal activities have been many and varied and have reached large numbers of 
professional educators. 

A film entitled "Sign On/Sign Off "was designed 'to give the basic idea of 
how a computer simulates- a tutor. The film describes the equipment and 
objectives of CAI and is available from the Audio-Visual Library of the Uni- 
versity (16mm; 24 minute; sound; color). 
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Table 6 



Organized Dissemination Activities 
by CAI Laboratory Personnel . 
'May 1 , 1967 through June 30, 1968 



Date(s) Participant(s) 



No. in 
Audience 



Event 



5/26/67 Mitzel, K. E. 
6/21/67 Mitzel, K- E. 



45 

60 



Center fgr Cooperative 
Research With Schools 



\ 



American Society for 
Engineering Education 
Annual Meeting 



Location 



Penn State 



East Lansing, 
Michigan 
(Michiqan 
State) 



! 7/1/67 

to 

j ' 7/20/67 

1 


Mitzel , H. E. ■ 

/ 


1000 


National Seminar on 
Innovation 

Sponsored by I.D.E.A. 
The Action-Oriented 
Division of the Chas. 
F. Kettering Founda- 
tion and USOE 


Honolulu, 

Hawaii 


7/26/67 

i 


Mitzel , H. E. 


100 


Computer Summer 
Workshop ® 


West Point, 
New York 


J 

8/.15/67 

! 


Igo, R'. V. 

r 

1 


50 


ENTELEK Workshop 


Harvard Univ 

Cambridge, 

Mass. 


J 8/8/67 


Mitzel , H. E. , 
Brandon, 6. 


200 


National Educational 
Media Seminar in 
Vocational and 
Technical Education 


Columbus, 

Ohio 


1 10/3/67 

1 


Mitzel , H. E. 


40 


Training program on 
Management Develop- 
ment for Health Agency 
Personnel, Hospital 
Administrators, etc. 


Penn State 


j 10/6/67 

1 


Mitzel , H. E . , 
Hall, K. A. 
Johnson, D. 
Riedesel, A. 


75 


USOE Demonstration 
Center 


Washington, 

D. C. 


1 

b ' 


1 


- 
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10/27/67 


Mi tzel , H. E. 
Hall . K. A. 


125 


Phi Delta Kappa 
Meeting, Alpha 
Chapter 


Penn State 


10/27/67 


Farr, H. L. K. 


45 


Pennsylvania Council 
of Teachers of 
English, 11th Annual 
Conference 


Penn State 


11/13/67 


Ml tzel , H. E. 


200 


Convocation of 
Educational Research 
Association of New 
York State 


Albany, 
New York 


11/9/67 


Ml tzel , H. E. 
Hall, K. A. 
Brown, B. R. 


20 


Psychologists from 
Penn State's Common- 
wealth Campuses 


Penn State 


zmm 


Ml tzel , H. E. 
Hall, K. A., 
Dwyer, C. 

Knul 1,0. 


35 


.Faculty Development 
Institute 


Penn State 

, / 


3/ 28/ 6b 


Hall, K. A. 


450 


NEA Department of 
Audio Visual Inst. 


Houston, 

Texas 


4/18/63 


Hall, K. A. 


150 


National Society of 
Programed Inst. 


San Antonio 
Texas 
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Table 7 

Visitors to CAI Laboratory 
May 1 , 1967 through April 30, 1968 



Number In groups . 
Individuals. . . . 
Total . . . . 



Countries Represented: 

Australia 

Canada 

England 

0 

Netherlands 

Sudan 



.919 
. 73 
.992 
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Table 8 



Summary 

1410 Student Terminal Usage 
May 1, 1967 through April 30, 1968 
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Use 


Number 


Hours 


Avg. Per. 
Month 


Students 


788* 


1,163.37 


96.95 


Staff 




330.65 


27.55 


Demonstrations 




109.44 


9.12 


A/V Testing 

I 




7.21 


.60 


Equipment Testing 




9.59 


.80 


Testing 


788 


1 ,620.26 


135.02 


♦Investigations 


694 


1,088.37 




Other Subjects 


94 


75.00 






788 


1,163.37 
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Table 9 

1500 System Usage 

February 1, 1968 through April 30, 1968 



System Usage 


No. of 
Hours 


Avg. Per. 
Month 


Author/Student 


1,336.95 


445.65 


Demonstrations 


58.03 


19.34 


Systems Work 


124.00 


41,33 


Preventive Maintenance 


26.00 


8.67 


Total 


1 ,544.98 


514.99 
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THE PENNSYLVANIA STATE UNIVERSITY 

College of Education 
201 Chambers Building 
University Park, Pennsylvania 16802 

Computer Assisted Instruction Laboratory 
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December 31, 1965 
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